2024-09-21T01:39:52.227 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T01:39:52.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T01:39:52.336 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913396 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7913396' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxYwI8Zc+A2sekgcnngzYmqTT4+I43XmG4O0VxpMF/xvwgTHwXy5+RaYGH2xosJ85X+iOtloaYs4XQ0sc7+rDs= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+gBucAyW+hJoh/mqOMPNDIwYnk9lKgBZ6T5hCukcce25Kf72YSccK0FUMABo6mPpXeGAVww+wzzGezXdKb31s= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T01:39:52.337 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T01:39:52.337 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T01:39:52.337 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T01:39:52.339 INFO:teuthology.task.internal:Checking packages... 2024-09-21T01:39:52.358 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T01:39:52.359 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T01:39:52.359 INFO:teuthology.packaging:ref: None 2024-09-21T01:39:52.359 INFO:teuthology.packaging:tag: None 2024-09-21T01:39:52.359 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T01:39:52.359 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:39:52.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T01:39:52.500 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T01:39:52.502 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T01:39:52.509 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T01:39:52.509 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T01:39:52.515 INFO:teuthology.task.internal:Saving configuration 2024-09-21T01:39:52.532 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T01:39:52.538 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T01:39:52.563 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913396', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 01:34:47.959381', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxYwI8Zc+A2sekgcnngzYmqTT4+I43XmG4O0VxpMF/xvwgTHwXy5+RaYGH2xosJ85X+iOtloaYs4XQ0sc7+rDs='} 2024-09-21T01:39:52.586 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913396', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 01:34:47.961052', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+gBucAyW+hJoh/mqOMPNDIwYnk9lKgBZ6T5hCukcce25Kf72YSccK0FUMABo6mPpXeGAVww+wzzGezXdKb31s='} 2024-09-21T01:39:52.586 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T01:39:52.592 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-21T01:39:52.592 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-21T01:39:52.592 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T01:39:52.648 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f63f1a80160>, signals=[15]) 2024-09-21T01:39:52.649 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T01:39:52.654 INFO:teuthology.task.internal:Opening connections... 2024-09-21T01:39:52.655 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-09-21T01:39:52.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:39:52.729 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-21T01:39:52.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:39:52.803 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T01:39:52.810 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-09-21T01:39:52.827 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-09-21T01:39:52.828 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-09-21T01:39:52.886 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T01:39:52.887 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-09-21T01:39:52.887 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T01:39:52.887 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T01:39:52.887 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T01:39:52.887 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-09-21T01:39:52.907 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-21T01:39:52.925 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-21T01:39:52.925 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-21T01:39:52.981 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-09-21T01:39:52.981 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-09-21T01:39:52.981 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-09-21T01:39:52.981 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T01:39:52.982 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T01:39:52.982 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-21T01:39:53.007 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T01:39:53.022 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T01:39:53.039 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T01:39:53.039 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-09-21T01:39:53.042 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-21T01:39:53.058 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T01:39:53.063 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T01:39:53.063 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-09-21T01:39:53.099 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-21T01:39:53.192 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T01:39:53.244 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T01:39:53.257 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T01:39:53.258 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-21T01:39:53.258 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-21T01:39:53.258 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T01:39:53.258 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T01:39:53.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:39:53.278 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-21T01:39:53.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:39:53.279 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-21T01:39:53.336 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-503.el9.x86_64 2024-09-21T01:39:53.336 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.14.0-503.el9.x86_64 2024-09-21T01:39:53.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y kernel 2024-09-21T01:39:53.339 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-503.el9.x86_64 2024-09-21T01:39:53.339 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.14.0-503.el9.x86_64 2024-09-21T01:39:53.339 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2024-09-21T01:39:56.448 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.3 MB 00:01 2024-09-21T01:39:56.912 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.3 MB 00:01 2024-09-21T01:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-21T01:39:59.996 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-21T01:40:02.982 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-21T01:40:04.280 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T01:40:04.599 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-21T01:40:05.653 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T01:40:05.865 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-21T01:40:06.802 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T01:40:11.001 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T01:40:12.417 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T01:40:12.907 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T01:40:12.907 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T01:40:12.991 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-21T01:40:12.999 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout:Install 4 Packages 2024-09-21T01:40:13.000 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:40:13.001 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 79 M 2024-09-21T01:40:13.001 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 126 M 2024-09-21T01:40:13.001 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-21T01:40:13.127 INFO:teuthology.orchestra.run.smithi139.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 463 kB/s | 36 kB 00:00 2024-09-21T01:40:14.390 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T01:40:14.390 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T01:40:14.492 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T01:40:14.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:40:14.503 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-09-21T01:40:14.503 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-21T01:40:14.503 INFO:teuthology.orchestra.run.smithi040.stdout:Install 4 Packages 2024-09-21T01:40:14.503 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:40:14.503 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 79 M 2024-09-21T01:40:14.503 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 126 M 2024-09-21T01:40:14.503 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-09-21T01:40:14.917 INFO:teuthology.orchestra.run.smithi040.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 124 kB/s | 36 kB 00:00 2024-09-21T01:40:16.018 INFO:teuthology.orchestra.run.smithi040.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T01:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 7.5 MB/s | 29 MB 00:03 2024-09-21T01:40:17.235 INFO:teuthology.orchestra.run.smithi139.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-21T01:40:17.276 INFO:teuthology.orchestra.run.smithi040.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-21T01:40:17.593 INFO:teuthology.orchestra.run.smithi040.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 12 MB/s | 35 MB 00:02 2024-09-21T01:40:17.593 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:40:17.593 INFO:teuthology.orchestra.run.smithi040.stdout:Total 25 MB/s | 79 MB 00:03 2024-09-21T01:40:18.094 INFO:teuthology.orchestra.run.smithi139.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 6.8 MB/s | 35 MB 00:05 2024-09-21T01:40:18.094 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:40:18.094 INFO:teuthology.orchestra.run.smithi139.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-21T01:40:18.303 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-09-21T01:40:18.704 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-09-21T01:40:18.704 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-09-21T01:40:18.776 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-21T01:40:19.127 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-21T01:40:19.127 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-21T01:40:19.664 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-09-21T01:40:19.665 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-09-21T01:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-21T01:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-21T01:40:22.243 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-09-21T01:40:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-21T01:40:22.904 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:40:22.985 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:40:23.145 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:40:23.235 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:40:25.739 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:40:25.871 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:40:25.974 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:40:26.105 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:40:30.944 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:40:31.005 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:40:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:40:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:40:35.947 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:40:36.189 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:41:14.120 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:41:14.159 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:41:14.473 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:41:14.473 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:41:14.474 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:41:14.474 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:41:15.152 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:41:15.193 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:41:15.342 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:41:15.342 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:41:15.343 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-21T01:41:15.343 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T01:41:15.343 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T01:41:15.343 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T01:41:15.343 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T01:41:15.343 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:41:15.343 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-21T01:41:15.586 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:41:15.586 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:41:15.586 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:41:15.586 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:41:15.707 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:41:15.798 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:41:15.799 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:41:15.799 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T01:41:15.799 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T01:41:15.799 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T01:41:15.799 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-21T01:41:15.799 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T01:41:15.799 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:41:15.857 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:41:15.858 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:41:15.859 DEBUG:teuthology.orchestra.run.smithi139:> sudo rpm -qi grub2-tools 2024-09-21T01:41:15.889 INFO:teuthology.orchestra.run.smithi139.stdout:Name : grub2-tools 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Epoch : 1 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Version : 2.06 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Release : 82.el9 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: x86_64 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Group : Unspecified 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Size : 8274670 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:License : GPLv3+ 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T01:41:15.890 INFO:teuthology.orchestra.run.smithi139.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:Packager : builder@centos.org 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:Vendor : CentOS 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:Summary : Support tools for GRUB. 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:Description : 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:hardware devices. 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:41:15.891 INFO:teuthology.orchestra.run.smithi139.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T01:41:15.892 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T01:41:15.892 INFO:teuthology.task.kernel:Updating grub on smithi139 to boot 5.14.0-508.el9.x86_64 2024-09-21T01:41:15.893 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T01:41:16.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:41:16.455 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:41:16.455 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-09-21T01:41:16.455 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T01:41:16.455 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T01:41:16.455 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T01:41:16.455 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T01:41:16.455 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:41:16.455 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-21T01:41:16.499 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-09-21T01:41:16.784 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:41:16.878 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:41:16.878 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:41:16.879 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T01:41:16.879 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T01:41:16.879 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T01:41:16.879 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T01:41:16.879 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T01:41:16.879 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:41:16.938 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:41:16.938 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:41:16.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2024-09-21T01:41:16.969 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2024-09-21T01:41:16.969 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.06 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 82.el9 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Group : Unspecified 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 8274670 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : builder@centos.org 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2024-09-21T01:41:16.970 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T01:41:16.971 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2024-09-21T01:41:16.971 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2024-09-21T01:41:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:41:16.971 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T01:41:16.971 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T01:41:16.971 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T01:41:16.971 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2024-09-21T01:41:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:41:16.971 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T01:41:16.972 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T01:41:16.972 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 5.14.0-508.el9.x86_64 2024-09-21T01:41:16.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T01:41:17.679 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-09-21T01:41:17.830 INFO:teuthology.orchestra.run.smithi139.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T01:41:17.887 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-09-21T01:41:17.889 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-21T01:41:17.905 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.MgNmJnvGSS 2024-09-21T01:41:17.905 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MgNmJnvGSS 2024-09-21T01:41:17.974 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.MgNmJnvGSS 2024-09-21T01:41:18.104 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.MgNmJnvGSS is 6KB 2024-09-21T01:41:18.152 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.MgNmJnvGSS 2024-09-21T01:41:18.167 DEBUG:teuthology.orchestra.run.smithi139:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T01:41:18.230 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T01:41:18.230 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T01:41:18.230 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T01:41:18.230 INFO:teuthology.orchestra.run.smithi139.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T01:41:18.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T01:41:18.395 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2024-09-21T01:41:19.056 INFO:teuthology.orchestra.run.smithi040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T01:41:19.087 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-09-21T01:41:19.091 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-09-21T01:41:19.106 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.RsXWddiDoQ 2024-09-21T01:41:19.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RsXWddiDoQ 2024-09-21T01:41:19.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.RsXWddiDoQ 2024-09-21T01:41:19.320 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.RsXWddiDoQ is 6KB 2024-09-21T01:41:19.367 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.RsXWddiDoQ 2024-09-21T01:41:19.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T01:41:19.451 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T01:41:19.452 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T01:41:19.452 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T01:41:19.452 INFO:teuthology.orchestra.run.smithi040.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T01:41:19.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T01:41:19.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-09-21T01:41:48.426 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-21T01:41:48.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-21T01:41:48.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:41:49.596 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T01:41:49.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-21T01:41:49.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:42:48.463 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T01:42:49.601 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T01:42:57.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-21T01:42:57.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:42:57.894 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-21T01:42:58.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-21T01:42:58.286 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-21T01:42:58.287 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-21T01:42:58.301 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-508.el9.x86_64 2024-09-21T01:42:58.301 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T01:42:58.301 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T01:42:58.301 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T01:42:58.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-21T01:42:58.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:42:59.302 DEBUG:teuthology.parallel:result is None 2024-09-21T01:42:59.448 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-21T01:42:59.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-21T01:42:59.911 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T01:42:59.911 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-21T01:42:59.926 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-508.el9.x86_64 2024-09-21T01:42:59.927 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T01:42:59.927 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T01:42:59.927 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T01:43:00.927 DEBUG:teuthology.parallel:result is None 2024-09-21T01:43:00.928 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T01:43:00.936 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T01:43:00.936 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T01:43:00.938 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T01:43:00.954 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T01:43:00.963 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T01:43:01.003 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T01:43:01.003 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T01:43:01.006 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T01:43:01.032 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T01:43:01.038 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T01:43:01.038 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T01:43:01.070 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T01:43:01.165 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:43:01.183 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:43:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:43:01.212 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:43:01.213 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T01:43:01.220 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T01:43:01.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T01:43:01.222 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T01:43:01.247 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T01:43:01.256 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T01:43:01.256 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T01:43:01.288 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T01:43:01.303 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:43:01.385 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:43:01.432 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:43:01.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:43:01.556 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:43:01.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T01:43:01.626 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:43:01.666 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:43:01.712 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:43:01.791 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:43:01.827 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:43:01.827 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T01:43:01.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-09-21T01:43:01.891 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-21T01:43:01.932 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:43:01.969 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:43:02.415 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T01:43:02.423 INFO:teuthology.task.internal:Starting timer... 2024-09-21T01:43:02.423 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T01:43:02.432 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T01:43:02.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-09-21T01:43:02.491 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-09-21T01:43:02.493 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-09-21T01:43:02.537 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-09-21T01:43:02.539 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T01:43:02.539 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-09-21T01:43:02.571 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-09-21T01:43:02.571 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-09-21T01:43:02.594 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-09-21T01:43:02.594 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive'} 2024-09-21T01:43:02.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T01:43:02.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:43:02.634 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T01:43:02.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:43:02.659 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T01:43:02.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-09-21T01:43:02.736 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-09-21T01:43:02.831 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T01:43:02.840 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T01:43:02.843 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T01:43:02.948 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T01:43:02.958 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T01:43:02.959 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T01:46:46.885 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2024-09-21T01:46:46.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-21T01:46:46.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:46:46.962 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-21T01:46:47.042 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-21T01:46:47.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-21T01:46:47.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:46:47.121 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-21T01:46:47.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-21T01:46:47.202 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T01:46:47.212 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T01:46:47.212 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:46:47.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:46:47.215 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:46:47.215 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:46:47.243 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:46:47.259 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:46:47.270 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:46:47.285 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:46:47.285 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-09-21T01:46:47.297 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-09-21T01:46:47.310 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-09-21T01:46:47.312 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:46:47.321 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-09-21T01:46:47.326 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:46:47.335 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:46:47.349 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:46:47.383 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:46:47.387 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:46:47.387 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-09-21T01:46:47.387 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:46:47.387 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:46:47.387 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:46:47.387 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:46:47.413 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:46:47.417 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:46:47.417 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-21T01:46:47.417 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:46:47.417 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:46:47.417 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:46:47.417 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:46:47.418 INFO:teuthology.run_tasks:Running task install... 2024-09-21T01:46:47.426 DEBUG:teuthology.task.install:project ceph 2024-09-21T01:46:47.426 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T01:46:47.426 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T01:46:47.426 INFO:teuthology.task.install:Using flavor: default 2024-09-21T01:46:47.431 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T01:46:47.432 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T01:46:47.432 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:46:47.432 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:46:47.434 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:46:47.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:46:47.577 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:46:47.577 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:46:47.585 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:46:47.585 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:46:47.686 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:46:47.687 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:46:47.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:46:47.694 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:46:47.694 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:46:47.694 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:46:47.714 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:46:47.715 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:46:47.720 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:46:47.720 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:46:47.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:46:47.785 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:46:47.860 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:46:47.861 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:46:47.924 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-09-21T01:46:47.925 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-09-21T01:46:47.926 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-09-21T01:46:47.927 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-09-21T01:46:48.150 INFO:teuthology.orchestra.run.smithi139.stdout:45 files removed 2024-09-21T01:46:48.164 INFO:teuthology.orchestra.run.smithi040.stdout:45 files removed 2024-09-21T01:46:48.177 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:46:48.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:46:48.725 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-21T01:46:48.767 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-21T01:46:49.017 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T01:46:49.067 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T01:46:49.301 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T01:46:49.334 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-21T01:46:50.251 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.3 MB 00:00 2024-09-21T01:46:50.601 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.3 MB 00:01 2024-09-21T01:46:52.371 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-21T01:46:56.169 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-21T01:46:56.828 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-21T01:46:58.512 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-21T01:46:59.384 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T01:47:03.190 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:03 2024-09-21T01:47:04.622 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 130 kB/s | 19 kB 00:00 2024-09-21T01:47:04.780 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T01:47:05.485 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-21T01:47:06.968 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:47:06.969 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:47:06.982 INFO:teuthology.orchestra.run.smithi139.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:47:06.983 INFO:teuthology.orchestra.run.smithi139.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:47:06.984 INFO:teuthology.orchestra.run.smithi139.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:47:06.985 INFO:teuthology.orchestra.run.smithi139.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:47:06.987 INFO:teuthology.orchestra.run.smithi139.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:47:06.990 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:47:06.991 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:47:07.053 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-21T01:47:07.071 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:47:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:47:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:47:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:47:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:47:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:47:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:47:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:47:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:47:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:47:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:47:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:47:07.083 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2024-09-21T01:47:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:47:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:47:07.084 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-21T01:47:07.084 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-09-21T01:47:07.084 INFO:teuthology.orchestra.run.smithi139.stdout:Install 149 Packages 2024-09-21T01:47:07.084 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 8 Packages 2024-09-21T01:47:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:47:07.084 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 228 M 2024-09-21T01:47:07.085 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-21T01:47:07.473 INFO:teuthology.orchestra.run.smithi139.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-21T01:47:07.715 INFO:teuthology.orchestra.run.smithi139.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.5 MB/s | 873 kB 00:00 2024-09-21T01:47:07.857 INFO:teuthology.orchestra.run.smithi139.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T01:47:07.882 INFO:teuthology.orchestra.run.smithi139.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 887 kB/s | 148 kB 00:00 2024-09-21T01:47:07.949 INFO:teuthology.orchestra.run.smithi139.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 25 MB/s | 2.3 MB 00:00 2024-09-21T01:47:08.074 INFO:teuthology.orchestra.run.smithi139.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 7.9 MB/s | 1.5 MB 00:00 2024-09-21T01:47:08.250 INFO:teuthology.orchestra.run.smithi139.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.0 MB 00:00 2024-09-21T01:47:08.475 INFO:teuthology.orchestra.run.smithi139.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T01:47:08.517 INFO:teuthology.orchestra.run.smithi139.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 608 kB/s | 25 kB 00:00 2024-09-21T01:47:08.884 INFO:teuthology.orchestra.run.smithi139.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 16 MB/s | 10 MB 00:00 2024-09-21T01:47:08.942 INFO:teuthology.orchestra.run.smithi139.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T01:47:09.143 INFO:teuthology.orchestra.run.smithi139.stdout:(12/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T01:47:09.168 INFO:teuthology.orchestra.run.smithi139.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 120 kB/s | 27 kB 00:00 2024-09-21T01:47:09.193 INFO:teuthology.orchestra.run.smithi139.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 638 kB/s | 32 kB 00:00 2024-09-21T01:47:09.227 INFO:teuthology.orchestra.run.smithi139.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 13 MB/s | 766 kB 00:00 2024-09-21T01:47:09.252 INFO:teuthology.orchestra.run.smithi139.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.6 MB/s | 158 kB 00:00 2024-09-21T01:47:09.277 INFO:teuthology.orchestra.run.smithi139.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T01:47:09.303 INFO:teuthology.orchestra.run.smithi139.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T01:47:09.352 INFO:teuthology.orchestra.run.smithi139.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 905 kB/s | 45 kB 00:00 2024-09-21T01:47:09.436 INFO:teuthology.orchestra.run.smithi139.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T01:47:09.545 INFO:teuthology.orchestra.run.smithi139.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.3 MB 00:00 2024-09-21T01:47:09.570 INFO:teuthology.orchestra.run.smithi139.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.2 MB/s | 161 kB 00:00 2024-09-21T01:47:09.595 INFO:teuthology.orchestra.run.smithi139.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T01:47:09.620 INFO:teuthology.orchestra.run.smithi139.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T01:47:09.646 INFO:teuthology.orchestra.run.smithi139.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T01:47:09.671 INFO:teuthology.orchestra.run.smithi139.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T01:47:09.730 INFO:teuthology.orchestra.run.smithi139.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-21T01:47:09.797 INFO:teuthology.orchestra.run.smithi139.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 21 MB/s | 3.1 MB 00:00 2024-09-21T01:47:09.822 INFO:teuthology.orchestra.run.smithi139.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 373 kB/s | 34 kB 00:00 2024-09-21T01:47:09.847 INFO:teuthology.orchestra.run.smithi139.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T01:47:10.372 INFO:teuthology.orchestra.run.smithi139.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-21T01:47:10.723 INFO:teuthology.orchestra.run.smithi139.stdout:(32/157): ceph-test-19.3.0-5120.g18432218.el9.x 18 MB/s | 40 MB 00:02 2024-09-21T01:47:10.748 INFO:teuthology.orchestra.run.smithi139.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 778 kB/s | 292 kB 00:00 2024-09-21T01:47:10.773 INFO:teuthology.orchestra.run.smithi139.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 988 kB/s | 49 kB 00:00 2024-09-21T01:47:10.798 INFO:teuthology.orchestra.run.smithi139.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T01:47:10.824 INFO:teuthology.orchestra.run.smithi139.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.5 MB/s | 285 kB 00:00 2024-09-21T01:47:10.966 INFO:teuthology.orchestra.run.smithi139.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T01:47:10.991 INFO:teuthology.orchestra.run.smithi139.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 110 kB/s | 18 kB 00:00 2024-09-21T01:47:11.016 INFO:teuthology.orchestra.run.smithi139.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.5 MB/s | 784 kB 00:00 2024-09-21T01:47:11.141 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T01:47:11.167 INFO:teuthology.orchestra.run.smithi139.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 398 kB/s | 80 kB 00:00 2024-09-21T01:47:11.258 INFO:teuthology.orchestra.run.smithi139.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 790 kB/s | 191 kB 00:00 2024-09-21T01:47:11.284 INFO:teuthology.orchestra.run.smithi139.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-21T01:47:11.334 INFO:teuthology.orchestra.run.smithi139.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T01:47:11.434 INFO:teuthology.orchestra.run.smithi139.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-21T01:47:11.484 INFO:teuthology.orchestra.run.smithi139.stdout:(45/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 801 kB 00:00 2024-09-21T01:47:11.510 INFO:teuthology.orchestra.run.smithi139.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-21T01:47:11.568 INFO:teuthology.orchestra.run.smithi139.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-21T01:47:11.735 INFO:teuthology.orchestra.run.smithi139.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 2.6 MB/s | 1.2 MB 00:00 2024-09-21T01:47:12.294 INFO:teuthology.orchestra.run.smithi139.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 879 kB/s | 689 kB 00:00 2024-09-21T01:47:12.319 INFO:teuthology.orchestra.run.smithi139.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 183 kB/s | 107 kB 00:00 2024-09-21T01:47:12.403 INFO:teuthology.orchestra.run.smithi139.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-21T01:47:12.453 INFO:teuthology.orchestra.run.smithi139.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-21T01:47:12.512 INFO:teuthology.orchestra.run.smithi139.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-21T01:47:12.620 INFO:teuthology.orchestra.run.smithi139.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-09-21T01:47:12.645 INFO:teuthology.orchestra.run.smithi139.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 136 kB/s | 18 kB 00:00 2024-09-21T01:47:12.729 INFO:teuthology.orchestra.run.smithi139.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-21T01:47:12.762 INFO:teuthology.orchestra.run.smithi139.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-21T01:47:12.838 INFO:teuthology.orchestra.run.smithi139.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-21T01:47:12.879 INFO:teuthology.orchestra.run.smithi139.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-21T01:47:13.055 INFO:teuthology.orchestra.run.smithi139.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-21T01:47:13.172 INFO:teuthology.orchestra.run.smithi139.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 209 kB/s | 24 kB 00:00 2024-09-21T01:47:13.222 INFO:teuthology.orchestra.run.smithi139.stdout:(62/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.9 MB/s | 3.0 MB 00:00 2024-09-21T01:47:13.272 INFO:teuthology.orchestra.run.smithi139.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 1.4 MB/s | 581 kB 00:00 2024-09-21T01:47:13.297 INFO:teuthology.orchestra.run.smithi139.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-21T01:47:13.339 INFO:teuthology.orchestra.run.smithi139.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T01:47:13.390 INFO:teuthology.orchestra.run.smithi139.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T01:47:13.415 INFO:teuthology.orchestra.run.smithi139.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 328 kB/s | 38 kB 00:00 2024-09-21T01:47:13.428 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:47:13.429 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:47:13.440 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:47:13.441 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:47:13.442 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:47:13.443 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:47:13.445 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:47:13.447 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:47:13.448 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:47:13.516 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-21T01:47:13.538 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:47:13.539 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:47:13.540 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:47:13.541 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:47:13.542 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:47:13.543 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:47:13.544 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:47:13.545 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:47:13.546 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:47:13.547 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:47:13.548 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:47:13.549 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:47:13.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:47:13.551 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-09-21T01:47:13.551 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-09-21T01:47:13.551 INFO:teuthology.orchestra.run.smithi040.stdout:Install 149 Packages 2024-09-21T01:47:13.551 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 8 Packages 2024-09-21T01:47:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:47:13.551 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 228 M 2024-09-21T01:47:13.551 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-09-21T01:47:13.649 INFO:teuthology.orchestra.run.smithi139.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-21T01:47:13.774 INFO:teuthology.orchestra.run.smithi139.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-21T01:47:13.891 INFO:teuthology.orchestra.run.smithi139.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T01:47:14.417 INFO:teuthology.orchestra.run.smithi040.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 56 kB/s | 6.6 kB 00:00 2024-09-21T01:47:14.424 INFO:teuthology.orchestra.run.smithi139.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.6 MB/s | 4.9 MB 00:01 2024-09-21T01:47:14.601 INFO:teuthology.orchestra.run.smithi040.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T01:47:14.710 INFO:teuthology.orchestra.run.smithi040.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.3 MB/s | 148 kB 00:00 2024-09-21T01:47:14.716 INFO:teuthology.orchestra.run.smithi139.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-21T01:47:14.810 INFO:teuthology.orchestra.run.smithi040.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T01:47:14.825 INFO:teuthology.orchestra.run.smithi139.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 808 kB/s | 87 kB 00:00 2024-09-21T01:47:14.893 INFO:teuthology.orchestra.run.smithi040.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-21T01:47:14.952 INFO:teuthology.orchestra.run.smithi040.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.4 MB/s | 2.3 MB 00:00 2024-09-21T01:47:15.152 INFO:teuthology.orchestra.run.smithi040.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.0 MB 00:00 2024-09-21T01:47:15.175 INFO:teuthology.orchestra.run.smithi139.stdout:(74/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2024-09-21T01:47:15.300 INFO:teuthology.orchestra.run.smithi139.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 490 kB/s | 61 kB 00:00 2024-09-21T01:47:15.544 INFO:teuthology.orchestra.run.smithi040.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T01:47:15.586 INFO:teuthology.orchestra.run.smithi040.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 609 kB/s | 25 kB 00:00 2024-09-21T01:47:15.676 INFO:teuthology.orchestra.run.smithi139.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-21T01:47:15.728 INFO:teuthology.orchestra.run.smithi040.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 18 MB/s | 10 MB 00:00 2024-09-21T01:47:15.787 INFO:teuthology.orchestra.run.smithi040.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T01:47:15.962 INFO:teuthology.orchestra.run.smithi040.stdout:(12/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 18 MB/s | 18 MB 00:01 2024-09-21T01:47:15.987 INFO:teuthology.orchestra.run.smithi040.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 135 kB/s | 27 kB 00:00 2024-09-21T01:47:16.012 INFO:teuthology.orchestra.run.smithi040.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 635 kB/s | 32 kB 00:00 2024-09-21T01:47:16.034 INFO:teuthology.orchestra.run.smithi139.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-09-21T01:47:16.046 INFO:teuthology.orchestra.run.smithi040.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 13 MB/s | 766 kB 00:00 2024-09-21T01:47:16.059 INFO:teuthology.orchestra.run.smithi139.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 647 kB/s | 248 kB 00:00 2024-09-21T01:47:16.071 INFO:teuthology.orchestra.run.smithi040.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.6 MB/s | 158 kB 00:00 2024-09-21T01:47:16.096 INFO:teuthology.orchestra.run.smithi040.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T01:47:16.143 INFO:teuthology.orchestra.run.smithi139.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-21T01:47:16.143 INFO:teuthology.orchestra.run.smithi040.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 6.9 MB/s | 507 kB 00:00 2024-09-21T01:47:16.168 INFO:teuthology.orchestra.run.smithi139.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-21T01:47:16.222 INFO:teuthology.orchestra.run.smithi040.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 572 kB/s | 45 kB 00:00 2024-09-21T01:47:16.252 INFO:teuthology.orchestra.run.smithi139.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-21T01:47:16.277 INFO:teuthology.orchestra.run.smithi139.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-21T01:47:16.323 INFO:teuthology.orchestra.run.smithi040.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 23 MB/s | 5.3 MB 00:00 2024-09-21T01:47:16.348 INFO:teuthology.orchestra.run.smithi040.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.2 MB/s | 148 kB 00:00 2024-09-21T01:47:16.381 INFO:teuthology.orchestra.run.smithi040.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T01:47:16.407 INFO:teuthology.orchestra.run.smithi040.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.3 MB/s | 321 kB 00:00 2024-09-21T01:47:16.449 INFO:teuthology.orchestra.run.smithi040.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T01:47:16.474 INFO:teuthology.orchestra.run.smithi040.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.4 MB/s | 99 kB 00:00 2024-09-21T01:47:16.499 INFO:teuthology.orchestra.run.smithi040.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T01:47:16.558 INFO:teuthology.orchestra.run.smithi040.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-21T01:47:16.625 INFO:teuthology.orchestra.run.smithi040.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 21 MB/s | 3.1 MB 00:00 2024-09-21T01:47:16.652 INFO:teuthology.orchestra.run.smithi139.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-09-21T01:47:16.717 INFO:teuthology.orchestra.run.smithi040.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 216 kB/s | 34 kB 00:00 2024-09-21T01:47:16.742 INFO:teuthology.orchestra.run.smithi040.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.3 MB/s | 154 kB 00:00 2024-09-21T01:47:17.027 INFO:teuthology.orchestra.run.smithi139.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 592 kB/s | 222 kB 00:00 2024-09-21T01:47:17.176 INFO:teuthology.orchestra.run.smithi040.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-21T01:47:17.219 INFO:teuthology.orchestra.run.smithi139.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 403 kB/s | 77 kB 00:00 2024-09-21T01:47:17.235 INFO:teuthology.orchestra.run.smithi040.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T01:47:17.286 INFO:teuthology.orchestra.run.smithi139.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.9 MB/s | 5.1 MB 00:01 2024-09-21T01:47:17.302 INFO:teuthology.orchestra.run.smithi040.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 741 kB/s | 49 kB 00:00 2024-09-21T01:47:17.328 INFO:teuthology.orchestra.run.smithi139.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-09-21T01:47:17.403 INFO:teuthology.orchestra.run.smithi139.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-21T01:47:17.444 INFO:teuthology.orchestra.run.smithi040.stdout:(34/157): ceph-mgr-dashboard-19.3.0-5120.g18432 20 MB/s | 14 MB 00:00 2024-09-21T01:47:17.469 INFO:teuthology.orchestra.run.smithi040.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 98 kB/s | 16 kB 00:00 2024-09-21T01:47:17.494 INFO:teuthology.orchestra.run.smithi040.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T01:47:17.528 INFO:teuthology.orchestra.run.smithi040.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 13 MB/s | 784 kB 00:00 2024-09-21T01:47:17.546 INFO:teuthology.orchestra.run.smithi139.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-09-21T01:47:17.553 INFO:teuthology.orchestra.run.smithi040.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 313 kB/s | 18 kB 00:00 2024-09-21T01:47:17.654 INFO:teuthology.orchestra.run.smithi139.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 487 kB/s | 159 kB 00:00 2024-09-21T01:47:17.679 INFO:teuthology.orchestra.run.smithi139.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 385 kB/s | 51 kB 00:00 2024-09-21T01:47:17.763 INFO:teuthology.orchestra.run.smithi139.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 494 kB/s | 54 kB 00:00 2024-09-21T01:47:17.871 INFO:teuthology.orchestra.run.smithi139.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-21T01:47:17.954 INFO:teuthology.orchestra.run.smithi040.stdout:(39/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T01:47:17.979 INFO:teuthology.orchestra.run.smithi040.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 177 kB/s | 80 kB 00:00 2024-09-21T01:47:17.988 INFO:teuthology.orchestra.run.smithi139.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 379 kB/s | 44 kB 00:00 2024-09-21T01:47:18.112 INFO:teuthology.orchestra.run.smithi040.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-21T01:47:18.138 INFO:teuthology.orchestra.run.smithi040.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-21T01:47:18.171 INFO:teuthology.orchestra.run.smithi040.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-21T01:47:18.197 INFO:teuthology.orchestra.run.smithi040.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T01:47:18.222 INFO:teuthology.orchestra.run.smithi040.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T01:47:18.264 INFO:teuthology.orchestra.run.smithi040.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-09-21T01:47:18.289 INFO:teuthology.orchestra.run.smithi040.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-21T01:47:18.314 INFO:teuthology.orchestra.run.smithi040.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T01:47:18.364 INFO:teuthology.orchestra.run.smithi139.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 589 kB/s | 221 kB 00:00 2024-09-21T01:47:18.415 INFO:teuthology.orchestra.run.smithi040.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-21T01:47:18.448 INFO:teuthology.orchestra.run.smithi040.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 653 kB/s | 22 kB 00:00 2024-09-21T01:47:18.480 INFO:teuthology.orchestra.run.smithi139.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 308 kB/s | 36 kB 00:00 2024-09-21T01:47:18.499 INFO:teuthology.orchestra.run.smithi040.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-21T01:47:18.532 INFO:teuthology.orchestra.run.smithi040.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-21T01:47:18.549 INFO:teuthology.orchestra.run.smithi040.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-21T01:47:18.574 INFO:teuthology.orchestra.run.smithi040.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-21T01:47:18.591 INFO:teuthology.orchestra.run.smithi040.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 435 kB/s | 18 kB 00:00 2024-09-21T01:47:18.597 INFO:teuthology.orchestra.run.smithi139.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-21T01:47:18.608 INFO:teuthology.orchestra.run.smithi040.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-21T01:47:18.650 INFO:teuthology.orchestra.run.smithi040.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-21T01:47:18.676 INFO:teuthology.orchestra.run.smithi040.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-21T01:47:18.701 INFO:teuthology.orchestra.run.smithi040.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-21T01:47:18.793 INFO:teuthology.orchestra.run.smithi040.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-21T01:47:18.835 INFO:teuthology.orchestra.run.smithi040.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 587 kB/s | 24 kB 00:00 2024-09-21T01:47:18.877 INFO:teuthology.orchestra.run.smithi040.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-21T01:47:18.902 INFO:teuthology.orchestra.run.smithi040.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-21T01:47:18.977 INFO:teuthology.orchestra.run.smithi040.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-21T01:47:19.003 INFO:teuthology.orchestra.run.smithi040.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-21T01:47:19.028 INFO:teuthology.orchestra.run.smithi040.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-21T01:47:19.064 INFO:teuthology.orchestra.run.smithi139.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 652 kB/s | 304 kB 00:00 2024-09-21T01:47:19.181 INFO:teuthology.orchestra.run.smithi139.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 495 kB/s | 58 kB 00:00 2024-09-21T01:47:19.382 INFO:teuthology.orchestra.run.smithi139.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 479 kB/s | 96 kB 00:00 2024-09-21T01:47:19.437 INFO:teuthology.orchestra.run.smithi040.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-21T01:47:19.599 INFO:teuthology.orchestra.run.smithi139.stdout:(101/157): postgresql-server-13.16-1.el9.x86_64 1.0 MB/s | 5.8 MB 00:05 2024-09-21T01:47:19.624 INFO:teuthology.orchestra.run.smithi139.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 263 kB/s | 64 kB 00:00 2024-09-21T01:47:19.699 INFO:teuthology.orchestra.run.smithi139.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-21T01:47:19.724 INFO:teuthology.orchestra.run.smithi139.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 357 kB/s | 45 kB 00:00 2024-09-21T01:47:19.783 INFO:teuthology.orchestra.run.smithi139.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T01:47:19.825 INFO:teuthology.orchestra.run.smithi139.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-21T01:47:19.841 INFO:teuthology.orchestra.run.smithi139.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-21T01:47:19.875 INFO:teuthology.orchestra.run.smithi139.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-21T01:47:19.887 INFO:teuthology.orchestra.run.smithi040.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-09-21T01:47:19.917 INFO:teuthology.orchestra.run.smithi139.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-09-21T01:47:19.934 INFO:teuthology.orchestra.run.smithi139.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-21T01:47:19.974 INFO:teuthology.orchestra.run.smithi139.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-21T01:47:19.993 INFO:teuthology.orchestra.run.smithi139.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-21T01:47:20.077 INFO:teuthology.orchestra.run.smithi139.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-21T01:47:20.145 INFO:teuthology.orchestra.run.smithi040.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 3.4 MB/s | 910 kB 00:00 2024-09-21T01:47:20.237 INFO:teuthology.orchestra.run.smithi040.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T01:47:20.243 INFO:teuthology.orchestra.run.smithi139.stdout:(114/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.3 MB/s | 16 MB 00:02 2024-09-21T01:47:20.294 INFO:teuthology.orchestra.run.smithi139.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.7 MB/s | 839 kB 00:00 2024-09-21T01:47:20.304 INFO:teuthology.orchestra.run.smithi040.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-21T01:47:20.319 INFO:teuthology.orchestra.run.smithi139.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-21T01:47:20.344 INFO:teuthology.orchestra.run.smithi139.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2024-09-21T01:47:20.369 INFO:teuthology.orchestra.run.smithi139.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T01:47:20.388 INFO:teuthology.orchestra.run.smithi040.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-09-21T01:47:20.395 INFO:teuthology.orchestra.run.smithi139.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 1.7 MB/s | 548 kB 00:00 2024-09-21T01:47:20.420 INFO:teuthology.orchestra.run.smithi139.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-21T01:47:20.445 INFO:teuthology.orchestra.run.smithi139.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-21T01:47:20.446 INFO:teuthology.orchestra.run.smithi040.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T01:47:20.470 INFO:teuthology.orchestra.run.smithi139.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-21T01:47:20.496 INFO:teuthology.orchestra.run.smithi139.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-21T01:47:20.521 INFO:teuthology.orchestra.run.smithi139.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-21T01:47:20.546 INFO:teuthology.orchestra.run.smithi139.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-21T01:47:20.572 INFO:teuthology.orchestra.run.smithi139.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-21T01:47:20.597 INFO:teuthology.orchestra.run.smithi139.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-21T01:47:20.622 INFO:teuthology.orchestra.run.smithi139.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-09-21T01:47:20.647 INFO:teuthology.orchestra.run.smithi139.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 395 kB/s | 20 kB 00:00 2024-09-21T01:47:20.673 INFO:teuthology.orchestra.run.smithi139.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T01:47:20.697 INFO:teuthology.orchestra.run.smithi040.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.6 MB/s | 1.0 MB 00:00 2024-09-21T01:47:20.706 INFO:teuthology.orchestra.run.smithi139.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-21T01:47:20.740 INFO:teuthology.orchestra.run.smithi139.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-21T01:47:20.747 INFO:teuthology.orchestra.run.smithi040.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T01:47:20.765 INFO:teuthology.orchestra.run.smithi139.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 991 kB/s | 58 kB 00:00 2024-09-21T01:47:20.790 INFO:teuthology.orchestra.run.smithi139.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 665 kB/s | 16 kB 00:00 2024-09-21T01:47:20.816 INFO:teuthology.orchestra.run.smithi139.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T01:47:20.841 INFO:teuthology.orchestra.run.smithi139.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-21T01:47:20.847 INFO:teuthology.orchestra.run.smithi040.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T01:47:20.866 INFO:teuthology.orchestra.run.smithi139.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-21T01:47:20.891 INFO:teuthology.orchestra.run.smithi139.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-21T01:47:20.917 INFO:teuthology.orchestra.run.smithi139.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T01:47:20.942 INFO:teuthology.orchestra.run.smithi139.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T01:47:20.967 INFO:teuthology.orchestra.run.smithi139.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T01:47:20.972 INFO:teuthology.orchestra.run.smithi040.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-21T01:47:21.009 INFO:teuthology.orchestra.run.smithi139.stdout:(142/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-21T01:47:21.014 INFO:teuthology.orchestra.run.smithi040.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-21T01:47:21.034 INFO:teuthology.orchestra.run.smithi139.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-21T01:47:21.056 INFO:teuthology.orchestra.run.smithi040.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-21T01:47:21.060 INFO:teuthology.orchestra.run.smithi139.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T01:47:21.085 INFO:teuthology.orchestra.run.smithi139.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-21T01:47:21.110 INFO:teuthology.orchestra.run.smithi139.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-21T01:47:21.135 INFO:teuthology.orchestra.run.smithi139.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T01:47:21.157 INFO:teuthology.orchestra.run.smithi040.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-21T01:47:21.169 INFO:teuthology.orchestra.run.smithi139.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T01:47:21.215 INFO:teuthology.orchestra.run.smithi040.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-09-21T01:47:21.219 INFO:teuthology.orchestra.run.smithi139.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T01:47:21.386 INFO:teuthology.orchestra.run.smithi139.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T01:47:21.453 INFO:teuthology.orchestra.run.smithi139.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T01:47:21.562 INFO:teuthology.orchestra.run.smithi139.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 378 kB/s | 41 kB 00:00 2024-09-21T01:47:21.645 INFO:teuthology.orchestra.run.smithi139.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 5.4 MB/s | 2.3 MB 00:00 2024-09-21T01:47:21.704 INFO:teuthology.orchestra.run.smithi139.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-21T01:47:21.796 INFO:teuthology.orchestra.run.smithi139.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-21T01:47:21.921 INFO:teuthology.orchestra.run.smithi139.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.4 MB/s | 1.8 MB 00:00 2024-09-21T01:47:22.091 INFO:teuthology.orchestra.run.smithi040.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 3.1 MB/s | 5.8 MB 00:01 2024-09-21T01:47:22.182 INFO:teuthology.orchestra.run.smithi040.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-21T01:47:22.221 INFO:teuthology.orchestra.run.smithi139.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 2.4 MB 00:00 2024-09-21T01:47:22.227 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:47:22.228 INFO:teuthology.orchestra.run.smithi139.stdout:Total 15 MB/s | 228 MB 00:15 2024-09-21T01:47:22.283 INFO:teuthology.orchestra.run.smithi040.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2024-09-21T01:47:22.325 INFO:teuthology.orchestra.run.smithi040.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-09-21T01:47:22.367 INFO:teuthology.orchestra.run.smithi040.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 924 kB/s | 77 kB 00:00 2024-09-21T01:47:22.392 INFO:teuthology.orchestra.run.smithi040.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 632 kB/s | 42 kB 00:00 2024-09-21T01:47:22.468 INFO:teuthology.orchestra.run.smithi040.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T01:47:22.493 INFO:teuthology.orchestra.run.smithi040.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-21T01:47:22.535 INFO:teuthology.orchestra.run.smithi040.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T01:47:22.577 INFO:teuthology.orchestra.run.smithi040.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-21T01:47:22.610 INFO:teuthology.orchestra.run.smithi040.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-09-21T01:47:22.652 INFO:teuthology.orchestra.run.smithi040.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-21T01:47:22.694 INFO:teuthology.orchestra.run.smithi040.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T01:47:22.786 INFO:teuthology.orchestra.run.smithi040.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.4 MB/s | 221 kB 00:00 2024-09-21T01:47:22.828 INFO:teuthology.orchestra.run.smithi040.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 862 kB/s | 36 kB 00:00 2024-09-21T01:47:22.878 INFO:teuthology.orchestra.run.smithi040.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-09-21T01:47:22.945 INFO:teuthology.orchestra.run.smithi040.stdout:(98/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-09-21T01:47:22.987 INFO:teuthology.orchestra.run.smithi040.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-21T01:47:23.046 INFO:teuthology.orchestra.run.smithi040.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-21T01:47:23.071 INFO:teuthology.orchestra.run.smithi040.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-21T01:47:23.113 INFO:teuthology.orchestra.run.smithi040.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 954 kB/s | 64 kB 00:00 2024-09-21T01:47:23.138 INFO:teuthology.orchestra.run.smithi040.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-09-21T01:47:23.230 INFO:teuthology.orchestra.run.smithi040.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-21T01:47:23.280 INFO:teuthology.orchestra.run.smithi040.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T01:47:23.314 INFO:teuthology.orchestra.run.smithi040.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T01:47:23.339 INFO:teuthology.orchestra.run.smithi040.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T01:47:23.373 INFO:teuthology.orchestra.run.smithi040.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-21T01:47:23.423 INFO:teuthology.orchestra.run.smithi040.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 523 kB/s | 26 kB 00:00 2024-09-21T01:47:23.444 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-21T01:47:23.448 INFO:teuthology.orchestra.run.smithi040.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T01:47:23.482 INFO:teuthology.orchestra.run.smithi040.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-21T01:47:23.524 INFO:teuthology.orchestra.run.smithi040.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-21T01:47:23.597 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-21T01:47:23.597 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-21T01:47:23.608 INFO:teuthology.orchestra.run.smithi040.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-21T01:47:23.650 INFO:teuthology.orchestra.run.smithi040.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-21T01:47:23.675 INFO:teuthology.orchestra.run.smithi040.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T01:47:23.701 INFO:teuthology.orchestra.run.smithi040.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T01:47:23.726 INFO:teuthology.orchestra.run.smithi040.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 4.5 MB/s | 548 kB 00:00 2024-09-21T01:47:23.751 INFO:teuthology.orchestra.run.smithi040.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-21T01:47:23.785 INFO:teuthology.orchestra.run.smithi040.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T01:47:23.885 INFO:teuthology.orchestra.run.smithi040.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-09-21T01:47:23.911 INFO:teuthology.orchestra.run.smithi040.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-21T01:47:23.944 INFO:teuthology.orchestra.run.smithi040.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T01:47:23.978 INFO:teuthology.orchestra.run.smithi040.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T01:47:23.995 INFO:teuthology.orchestra.run.smithi040.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 644 kB/s | 11 kB 00:00 2024-09-21T01:47:24.020 INFO:teuthology.orchestra.run.smithi040.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-21T01:47:24.045 INFO:teuthology.orchestra.run.smithi040.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-21T01:47:24.071 INFO:teuthology.orchestra.run.smithi040.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-21T01:47:24.096 INFO:teuthology.orchestra.run.smithi040.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-21T01:47:24.155 INFO:teuthology.orchestra.run.smithi040.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-21T01:47:24.180 INFO:teuthology.orchestra.run.smithi040.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T01:47:24.205 INFO:teuthology.orchestra.run.smithi040.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T01:47:24.230 INFO:teuthology.orchestra.run.smithi040.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T01:47:24.264 INFO:teuthology.orchestra.run.smithi040.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-21T01:47:24.290 INFO:teuthology.orchestra.run.smithi040.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-21T01:47:24.340 INFO:teuthology.orchestra.run.smithi040.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-21T01:47:24.365 INFO:teuthology.orchestra.run.smithi040.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-21T01:47:24.390 INFO:teuthology.orchestra.run.smithi040.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-21T01:47:24.416 INFO:teuthology.orchestra.run.smithi040.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-21T01:47:24.441 INFO:teuthology.orchestra.run.smithi040.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T01:47:24.475 INFO:teuthology.orchestra.run.smithi040.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-21T01:47:24.500 INFO:teuthology.orchestra.run.smithi040.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-09-21T01:47:24.525 INFO:teuthology.orchestra.run.smithi040.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T01:47:24.559 INFO:teuthology.orchestra.run.smithi040.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-21T01:47:24.584 INFO:teuthology.orchestra.run.smithi040.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T01:47:24.610 INFO:teuthology.orchestra.run.smithi040.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-09-21T01:47:24.652 INFO:teuthology.orchestra.run.smithi040.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-09-21T01:47:24.677 INFO:teuthology.orchestra.run.smithi040.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T01:47:24.744 INFO:teuthology.orchestra.run.smithi040.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-21T01:47:24.944 INFO:teuthology.orchestra.run.smithi040.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T01:47:25.028 INFO:teuthology.orchestra.run.smithi040.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T01:47:25.236 INFO:teuthology.orchestra.run.smithi040.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 8.0 MB/s | 2.3 MB 00:00 2024-09-21T01:47:25.303 INFO:teuthology.orchestra.run.smithi040.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 614 kB/s | 41 kB 00:00 2024-09-21T01:47:25.370 INFO:teuthology.orchestra.run.smithi040.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.6 MB/s | 249 kB 00:00 2024-09-21T01:47:25.446 INFO:teuthology.orchestra.run.smithi040.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.3 MB/s | 1.8 MB 00:00 2024-09-21T01:47:25.487 INFO:teuthology.orchestra.run.smithi040.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-21T01:47:25.704 INFO:teuthology.orchestra.run.smithi040.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-09-21T01:47:25.785 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-21T01:47:25.785 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-21T01:47:28.038 INFO:teuthology.orchestra.run.smithi040.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.0 MB/s | 16 MB 00:05 2024-09-21T01:47:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:47:28.043 INFO:teuthology.orchestra.run.smithi040.stdout:Total 16 MB/s | 228 MB 00:14 2024-09-21T01:47:29.286 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-09-21T01:47:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-09-21T01:47:29.457 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-09-21T01:47:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-09-21T01:47:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-09-21T01:47:32.396 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-21T01:47:32.499 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:47:32.547 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:47:32.600 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:47:32.649 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:47:32.675 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:47:32.731 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:47:33.073 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:47:33.192 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:47:33.318 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:47:33.343 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:47:33.435 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:47:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:47:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:47:33.674 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:47:33.728 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:47:33.757 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:47:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:47:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:47:33.987 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:47:34.009 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:47:34.033 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:47:34.219 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:47:34.381 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:47:34.498 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:47:34.606 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:47:34.691 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:47:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:47:35.026 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:47:35.053 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:47:35.088 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:47:35.161 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:47:35.206 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:47:35.246 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:47:35.289 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:47:35.327 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:47:35.349 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:47:35.411 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:47:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:47:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:47:35.556 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:47:35.635 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:47:35.665 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:47:35.708 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:47:35.736 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:47:35.807 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:47:35.851 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:47:35.926 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:47:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:47:36.119 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:47:36.640 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:47:36.723 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:47:36.753 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:47:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:47:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:47:36.869 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:47:37.037 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:47:37.095 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:47:37.186 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:47:37.250 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:47:37.322 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:47:37.355 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:47:37.391 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:47:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:47:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:47:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:47:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:47:37.701 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:47:37.743 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:47:37.784 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:47:37.887 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:47:37.919 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:47:37.959 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:47:37.992 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:47:38.058 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:47:38.416 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:47:38.543 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:47:38.561 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-09-21T01:47:38.590 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:47:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:47:38.656 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:47:38.667 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:47:38.695 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:47:38.707 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:47:38.726 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:47:38.756 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:47:38.761 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:47:38.791 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:47:38.803 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:47:38.824 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:47:38.828 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:47:38.866 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:47:38.883 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:47:38.900 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:47:38.986 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:47:39.038 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:47:39.070 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:47:39.173 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:47:39.221 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:47:39.246 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:47:39.379 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:47:39.509 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:47:39.538 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:47:39.631 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:47:39.659 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:47:39.712 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:47:39.896 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:47:39.933 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:47:39.949 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:47:39.977 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:47:39.984 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:47:40.018 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:47:40.077 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:47:40.103 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:47:40.115 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:47:40.165 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:47:40.165 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:47:40.187 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:47:40.209 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:47:40.218 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:47:40.289 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:47:40.321 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:47:40.410 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:47:40.496 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:47:40.535 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:47:40.587 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:47:40.643 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:47:40.728 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:47:40.839 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:47:40.912 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:47:41.148 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:47:41.268 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:47:41.287 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:47:41.399 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:47:41.521 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:47:41.560 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:47:41.643 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:47:41.695 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:47:41.745 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:47:41.803 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:47:41.849 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:47:41.880 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:47:41.952 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:47:42.012 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:47:42.042 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:47:42.090 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:47:42.177 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:47:42.212 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:47:42.257 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:47:42.293 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:47:42.375 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:47:42.425 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:47:42.503 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:47:42.648 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:47:42.674 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:47:42.704 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:47:42.754 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:47:42.782 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:47:42.815 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:47:43.140 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:47:43.178 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:47:43.261 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:47:43.269 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:47:43.299 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:47:43.336 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:47:43.359 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:47:43.393 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:47:43.444 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:47:43.475 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:47:43.517 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:47:43.702 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:47:43.761 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:47:43.833 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:47:43.856 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:47:43.864 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:47:43.928 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:47:43.935 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:47:43.965 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:47:44.001 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:47:44.038 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:47:44.074 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:47:44.122 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:47:44.157 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:47:44.201 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:47:44.251 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:47:44.394 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:47:44.595 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:47:44.637 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:47:44.744 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:47:44.778 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:47:44.847 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:47:44.876 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:47:44.900 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:47:45.011 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:47:45.150 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:47:45.187 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:47:45.225 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:47:45.266 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:47:45.313 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:47:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:47:45.391 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:47:45.426 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:47:45.459 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:47:45.501 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:47:45.535 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:47:45.625 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:47:45.675 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:47:45.714 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:47:45.822 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:47:45.999 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:47:46.167 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:47:46.203 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:47:46.760 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:47:46.777 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:47:46.811 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:47:46.817 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:47:46.857 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:47:46.907 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:47:46.907 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:47:46.907 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:47:46.907 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:47:46.950 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:47:46.957 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:47:47.010 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:47:47.054 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:47:47.154 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:47:47.307 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:47:47.497 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:47:47.531 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:47:47.619 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:47:48.308 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:47:48.433 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:47:49.758 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:47:49.851 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:47:49.879 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:47:49.912 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:47:50.272 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:47:50.317 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:47:50.393 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:47:50.422 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:47:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:47:50.986 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:47:51.012 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:47:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:47:51.122 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:47:53.477 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:47:53.509 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:47:54.111 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:47:54.146 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:47:54.222 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:47:54.223 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:47:54.223 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:47:54.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:47:54.264 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:47:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:47:58.885 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-09-21T01:47:58.885 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-09-21T01:47:58.885 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-09-21T01:47:58.885 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-09-21T01:47:58.885 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-09-21T01:47:58.886 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-09-21T01:47:58.886 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-09-21T01:47:58.886 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:47:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:47:59.077 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:47:59.077 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:47:59.077 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:47:59.077 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:00.697 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:48:00.724 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:48:00.724 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:00.725 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:48:00.725 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:48:00.725 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:48:00.725 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:48:00.972 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:48:00.972 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:00.972 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:48:00.972 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:48:00.972 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:48:00.972 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:01.449 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:48:01.472 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:48:01.472 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:01.472 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:48:01.472 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:48:01.472 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:48:01.472 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:01.579 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:48:01.636 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:48:01.691 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:48:01.875 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:48:01.924 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:48:02.003 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:48:02.089 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:48:02.229 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:48:02.266 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:48:02.298 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:48:02.326 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:48:02.776 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:48:02.807 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:48:02.839 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:48:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:48:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:48:06.109 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:48:06.161 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:48:06.587 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:48:06.587 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2024-09-21T01:48:06.587 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2024-09-21T01:48:06.587 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2024-09-21T01:48:06.587 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2024-09-21T01:48:06.587 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2024-09-21T01:48:06.587 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2024-09-21T01:48:06.587 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2024-09-21T01:48:06.587 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:06.761 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:48:06.780 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:48:06.780 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:06.780 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:48:06.780 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:48:07.152 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:48:07.266 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:48:07.436 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:48:07.463 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:48:07.487 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:48:07.488 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:07.488 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:48:07.488 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:48:07.488 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:48:07.488 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:07.538 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:48:07.550 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:48:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:48:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:48:08.448 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:48:08.476 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:48:08.476 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:08.476 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:48:08.476 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:48:08.476 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:48:08.476 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:08.668 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:48:08.699 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:48:08.715 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:48:08.723 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:48:08.724 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:08.724 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:48:08.724 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:48:08.724 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:48:08.724 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:08.739 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:48:08.740 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:08.740 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:48:08.740 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:48:08.740 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:48:08.740 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:08.767 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:48:08.790 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:48:08.790 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:08.790 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:48:08.790 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:08.842 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:48:08.866 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:48:08.866 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:08.866 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:48:08.866 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:48:08.866 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:48:08.866 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:09.184 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:48:09.208 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:48:09.208 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:09.208 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:48:09.208 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:48:09.208 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:48:09.208 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:09.233 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:48:09.257 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:48:09.257 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:09.257 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:48:09.257 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:48:09.257 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:48:09.257 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:09.364 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:48:09.421 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:48:09.493 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:48:09.694 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:48:09.751 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:48:09.831 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:48:09.920 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:48:10.071 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:48:10.109 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:48:10.141 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:48:10.177 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:48:10.624 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:48:10.659 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:48:10.692 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:48:10.762 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:48:10.799 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:48:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:48:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:48:13.286 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:48:13.318 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:48:13.346 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:48:13.552 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:48:13.592 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:48:13.631 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:48:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:48:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:48:14.176 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:48:14.229 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:48:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:48:14.346 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:48:14.367 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:48:15.202 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:48:15.244 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:48:15.275 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:48:15.280 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:48:15.320 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:48:15.399 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:48:15.416 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:48:15.446 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:48:15.470 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:48:15.504 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:48:15.505 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:48:15.571 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:48:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:48:15.580 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:48:15.598 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:48:15.624 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:48:15.624 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:15.624 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:48:15.624 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:48:15.625 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:48:15.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:48:15.674 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:48:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:48:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:48:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:48:15.686 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:48:15.789 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:48:15.849 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:48:15.865 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:48:15.866 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:48:15.950 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:48:16.015 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:48:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:48:16.910 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:48:16.935 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:48:16.935 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:16.935 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:48:16.935 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:48:16.935 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:48:16.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:16.977 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:48:17.001 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:48:17.002 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:17.002 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:48:17.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:17.053 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:48:17.077 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:48:17.077 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:17.077 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:48:17.078 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:48:17.078 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:48:17.078 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:17.412 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:48:17.437 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:48:17.437 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:48:17.437 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:48:17.437 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:48:17.437 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:48:17.437 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:21.715 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:48:21.759 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:48:21.807 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:48:21.851 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:48:21.874 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:48:22.102 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:48:22.138 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:48:22.168 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:48:22.207 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:48:22.261 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:48:22.358 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:48:22.358 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:48:22.358 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:48:22.358 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:48:22.358 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:48:22.358 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:48:22.358 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:48:22.358 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:48:22.358 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:48:22.359 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:48:22.360 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:48:22.361 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:48:22.362 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:48:22.363 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:48:22.364 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:48:22.365 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:48:22.366 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:48:22.367 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:48:22.368 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:48:22.369 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:48:22.370 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:48:22.904 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:48:22.942 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:48:22.963 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:48:23.867 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:48:23.963 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:48:24.012 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:48:24.110 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:48:24.142 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:48:24.167 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:48:24.193 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:48:24.193 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:48:24.277 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:48:24.277 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:48:24.370 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:48:24.394 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:48:24.400 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:48:24.400 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:48:24.588 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:48:24.588 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:48:24.672 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:48:24.741 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:48:24.816 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:48:24.816 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:24.816 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-09-21T01:48:24.816 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.817 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.818 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:48:24.819 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:48:24.820 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:48:24.821 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:48:24.822 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:48:24.823 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:48:24.824 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:48:24.825 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:48:24.826 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:48:24.827 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:48:24.828 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:48:24.829 INFO:teuthology.orchestra.run.smithi139.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:48:24.829 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:48:24.829 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:48:24.829 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:48:24.829 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:24.829 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-21T01:48:25.282 DEBUG:teuthology.parallel:result is None 2024-09-21T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:48:31.035 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:48:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:48:31.037 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:48:31.048 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:48:31.049 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:48:31.050 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:48:31.051 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:48:31.052 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:48:31.053 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:48:31.054 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:48:31.055 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:48:31.056 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:48:31.057 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:48:31.058 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:48:33.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:48:33.969 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:33.969 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-09-21T01:48:33.970 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:48:33.970 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:48:33.970 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:48:33.970 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:48:33.970 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.970 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.971 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:48:33.971 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:48:33.971 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-09-21T01:48:33.971 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:48:33.971 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:48:33.971 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:48:33.972 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:48:33.972 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.972 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.972 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.972 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.972 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.972 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.973 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.973 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.973 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.973 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.973 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.973 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.974 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.974 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.974 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.974 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.974 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.974 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.975 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.975 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.975 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.975 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.975 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.975 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:48:33.976 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:48:33.976 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:48:33.976 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:48:33.976 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:48:33.976 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:48:33.976 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:48:33.976 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:48:33.977 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:48:33.977 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:48:33.977 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:48:33.977 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:48:33.977 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.978 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.978 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.978 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:48:33.978 INFO:teuthology.orchestra.run.smithi040.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:48:33.978 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:48:33.978 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:48:33.979 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:48:33.979 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:48:33.979 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.979 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.979 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:48:33.979 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.980 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:48:33.980 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:48:33.980 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:48:33.980 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:48:33.980 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:48:33.980 INFO:teuthology.orchestra.run.smithi040.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:48:33.980 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:48:33.981 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:48:33.981 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:48:33.981 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:48:33.981 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:48:33.981 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:48:33.981 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:48:33.982 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:48:33.982 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:48:33.982 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:48:33.982 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:48:33.982 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:48:33.982 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:48:33.983 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:48:33.983 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:48:33.983 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:48:33.983 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:48:33.983 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.984 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.984 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.984 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:48:33.984 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:48:33.984 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:48:33.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:48:33.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:48:33.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:48:33.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:48:33.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:48:33.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:48:33.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:48:33.986 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:48:33.986 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:48:33.986 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:48:33.986 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:48:33.986 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:48:33.986 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:48:33.986 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:48:33.986 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:48:33.987 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:48:33.987 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:48:33.987 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:48:33.987 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:48:33.987 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:48:33.987 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:48:33.987 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:48:33.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:48:33.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:48:33.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:48:33.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:48:33.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:48:33.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:48:33.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:48:33.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:48:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:48:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:48:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:48:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:48:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:48:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:48:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:48:33.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:48:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:48:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:48:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:48:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:48:33.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:48:33.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:48:33.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:48:33.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:48:33.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:48:33.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:48:33.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:48:33.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:48:33.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:48:33.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:48:33.992 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:48:33.992 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:48:33.992 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:48:33.992 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.992 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.993 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:48:33.993 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:48:33.993 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:48:33.993 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:48:33.993 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:48:33.993 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:48:33.994 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:48:33.994 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:48:33.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:33.995 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-21T01:48:34.523 DEBUG:teuthology.parallel:result is None 2024-09-21T01:48:34.524 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:48:34.673 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:48:34.697 INFO:teuthology.orchestra.run.smithi040.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:48:34.697 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:48:34.698 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:48:34.699 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:48:34.844 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:48:34.870 INFO:teuthology.orchestra.run.smithi139.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:48:34.870 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:48:34.871 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:48:34.874 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T01:48:34.874 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:34.874 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:48:34.905 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:48:34.905 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:48:34.942 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T01:48:34.943 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:34.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:48:34.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:48:35.041 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:48:35.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:48:35.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:48:35.138 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T01:48:35.138 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:35.138 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:48:35.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:48:35.232 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:48:35.232 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:48:35.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:48:35.326 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T01:48:35.327 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:35.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:48:35.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:48:35.419 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:48:35.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:48:35.446 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:48:35.513 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T01:48:35.586 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T01:48:35.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2024-09-21T01:48:35.588 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2024-09-21T01:48:35.615 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T01:48:35.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T01:48:35.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T01:48:35.681 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T01:48:35.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T01:48:35.723 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T01:48:35.757 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-21T01:48:35.758 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-21T01:48:35.758 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-21T01:48:35.758 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:35.758 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T01:48:35.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T01:48:35.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T01:48:35.941 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:48:35.941 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T01:48:35.957 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T01:48:36.071 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T01:48:36.102 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T01:48:36.102 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T01:48:36.102 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913396', 'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7913396', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240920.212106-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7864, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240920.212106-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMxYwI8Zc+A2sekgcnngzYmqTT4+I43XmG4O0VxpMF/xvwgTHwXy5+RaYGH2xosJ85X+iOtloaYs4XQ0sc7+rDs=', 'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+gBucAyW+hJoh/mqOMPNDIwYnk9lKgBZ6T5hCukcce25Kf72YSccK0FUMABo6mPpXeGAVww+wzzGezXdKb31s='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_23:48:22', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T01:48:36.103 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T01:48:36.107 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T01:48:36.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T01:48:36.163 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T01:48:36.218 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:36.218 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:48:36.244 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:48:36.244 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-09-21T01:48:36.301 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:48:36.301 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:48:36.301 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T01:48:36.301 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:48:36.301 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:48:36.301 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-21 01:48:25.114952554 +0000 2024-09-21T01:48:36.301 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-21 01:46:27.046329902 +0000 2024-09-21T01:48:36.301 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-21 01:46:27.046329902 +0000 2024-09-21T01:48:36.301 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-21 01:46:27.046329902 +0000 2024-09-21T01:48:36.301 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:48:36.366 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-21T01:48:36.366 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-21T01:48:36.366 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000329587 s, 1.6 MB/s 2024-09-21T01:48:36.368 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:48:36.425 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-09-21T01:48:36.481 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:48:36.481 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:48:36.481 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T01:48:36.481 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:48:36.481 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:48:36.481 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-21 01:48:25.114952554 +0000 2024-09-21T01:48:36.481 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-21 01:46:27.380326301 +0000 2024-09-21T01:48:36.481 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-21 01:46:27.380326301 +0000 2024-09-21T01:48:36.481 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-21 01:46:27.380326301 +0000 2024-09-21T01:48:36.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:48:36.545 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-21T01:48:36.545 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-21T01:48:36.545 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.00019877 s, 2.6 MB/s 2024-09-21T01:48:36.546 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:48:36.602 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-09-21T01:48:36.659 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:48:36.659 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:48:36.659 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T01:48:36.659 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:48:36.659 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:48:36.659 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-21 01:48:25.114952554 +0000 2024-09-21T01:48:36.659 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-21 01:46:27.693322927 +0000 2024-09-21T01:48:36.659 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-21 01:46:27.693322927 +0000 2024-09-21T01:48:36.659 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-21 01:46:27.693322927 +0000 2024-09-21T01:48:36.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:48:36.723 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-21T01:48:36.723 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-21T01:48:36.723 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000185454 s, 2.8 MB/s 2024-09-21T01:48:36.724 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:48:36.781 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-09-21T01:48:36.837 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:48:36.837 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:48:36.837 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T01:48:36.837 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:48:36.837 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:48:36.837 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-21 01:48:25.115952543 +0000 2024-09-21T01:48:36.837 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-21 01:46:28.017319433 +0000 2024-09-21T01:48:36.837 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-21 01:46:28.017319433 +0000 2024-09-21T01:48:36.837 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-09-21 01:46:28.017319433 +0000 2024-09-21T01:48:36.837 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:48:36.900 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-21T01:48:36.901 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-21T01:48:36.901 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000200318 s, 2.6 MB/s 2024-09-21T01:48:36.902 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:48:36.959 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:36.959 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:48:36.959 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:48:36.977 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:48:36.977 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-21T01:48:37.035 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:48:37.035 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:48:37.035 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T01:48:37.035 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:48:37.035 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:48:37.035 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-21 01:48:16.358358368 +0000 2024-09-21T01:48:37.035 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-21 01:46:27.039231957 +0000 2024-09-21T01:48:37.035 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-21 01:46:27.039231957 +0000 2024-09-21T01:48:37.035 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-21 01:46:27.039231957 +0000 2024-09-21T01:48:37.035 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:48:37.101 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-21T01:48:37.101 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-21T01:48:37.101 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000237442 s, 2.2 MB/s 2024-09-21T01:48:37.103 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:48:37.161 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-21T01:48:37.217 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:48:37.217 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:48:37.217 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T01:48:37.218 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:48:37.218 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:48:37.218 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-21 01:48:16.359358348 +0000 2024-09-21T01:48:37.218 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-21 01:46:27.364225276 +0000 2024-09-21T01:48:37.218 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-21 01:46:27.364225276 +0000 2024-09-21T01:48:37.218 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-21 01:46:27.364225276 +0000 2024-09-21T01:48:37.218 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:48:37.283 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-21T01:48:37.283 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-21T01:48:37.283 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000199036 s, 2.6 MB/s 2024-09-21T01:48:37.285 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:48:37.342 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-21T01:48:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:48:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:48:37.398 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T01:48:37.398 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:48:37.398 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:48:37.398 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-21 01:48:16.359358348 +0000 2024-09-21T01:48:37.398 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-21 01:46:27.692218534 +0000 2024-09-21T01:48:37.398 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-21 01:46:27.692218534 +0000 2024-09-21T01:48:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-21 01:46:27.692218534 +0000 2024-09-21T01:48:37.399 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:48:37.461 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-21T01:48:37.461 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-21T01:48:37.461 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000191823 s, 2.7 MB/s 2024-09-21T01:48:37.463 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:48:37.519 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-21T01:48:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:48:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:48:37.575 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T01:48:37.575 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:48:37.575 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:48:37.576 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-21 01:48:16.359358348 +0000 2024-09-21T01:48:37.576 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-21 01:46:28.007212059 +0000 2024-09-21T01:48:37.576 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-21 01:46:28.007212059 +0000 2024-09-21T01:48:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-21 01:46:28.007212059 +0000 2024-09-21T01:48:37.576 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:48:37.639 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-21T01:48:37.639 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-21T01:48:37.639 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000199391 s, 2.6 MB/s 2024-09-21T01:48:37.641 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:48:37.696 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:37.696 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T01:48:37.697 INFO:tasks.ceph:Generating config... 2024-09-21T01:48:37.698 INFO:tasks.ceph:[client] pid file = 2024-09-21T01:48:37.698 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-21T01:48:37.698 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T01:48:37.698 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T01:48:37.698 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T01:48:37.698 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T01:48:37.698 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T01:48:37.698 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-21T01:48:37.698 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T01:48:37.698 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T01:48:37.698 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T01:48:37.698 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T01:48:37.699 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T01:48:37.699 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T01:48:37.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T01:48:37.767 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T01:48:37.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T01:48:37.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T01:48:37.855 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.139'), ('mon.c', '[v2:172.21.15.139:3301,v1:172.21.15.139:6790]')] 2024-09-21T01:48:37.855 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.139,[v2:172.21.15.139:3301,v1:172.21.15.139:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-21T01:48:37.856 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:37.856 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T01:48:37.911 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.139 --addv c '[v2:172.21.15.139:3301,v1:172.21.15.139:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:48:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:48:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid 52e0e71c-26ee-4828-88d9-740be2c186cd 2024-09-21T01:48:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = quincy 2024-09-21T01:48:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2024-09-21T01:48:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:fsid 52e0e71c-26ee-4828-88d9-740be2c186cd 2024-09-21T01:48:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2024-09-21T01:48:38.010608+0000 2024-09-21T01:48:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-09-21T01:48:38.010608+0000 2024-09-21T01:48:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 17 (quincy) 2024-09-21T01:48:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2024-09-21T01:48:38.011 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-21T01:48:38.011 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-21T01:48:38.011 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] mon.c 2024-09-21T01:48:38.011 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T01:48:38.012 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T01:48:38.027 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 52e0e71c-26ee-4828-88d9-740be2c186cd... 2024-09-21T01:48:38.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T01:48:38.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T01:48:38.111 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-09-21T01:48:38.111 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2024-09-21T01:48:38.111 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T01:48:38.111 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2024-09-21T01:48:38.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.111 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2024-09-21T01:48:38.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T01:48:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2024-09-21T01:48:38.113 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.139,[v2:172.21.15.139:3301,v1:172.21.15.139:6790]" 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on skipped message = False 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 52e0e71c-26ee-4828-88d9-740be2c186cd 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2024-09-21T01:48:38.114 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2024-09-21T01:48:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2024-09-21T01:48:38.116 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2024-09-21T01:48:38.117 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2024-09-21T01:48:38.118 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: mon down mkfs grace = 300 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:48:38.119 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-09-21T01:48:38.120 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.121 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-09-21T01:48:38.122 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-09-21T01:48:38.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.40,172.21.15.139,[v2:172.21.15.139:3301,v1:172.21.15.139:6790]" 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on skipped message = False 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 52e0e71c-26ee-4828-88d9-740be2c186cd 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-09-21T01:48:38.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug trim objects = true 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.125 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: bdev async discard = True 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: bdev enable discard = True 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore allocator = bitmap 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 1/20 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 1/20 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 4/10 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2024-09-21T01:48:38.126 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-21T01:48:38.127 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.128 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: mon down mkfs grace = 300 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = "" 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2024-09-21T01:48:38.129 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2024-09-21T01:48:38.130 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2024-09-21T01:48:38.130 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2024-09-21T01:48:38.130 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2024-09-21T01:48:38.130 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2024-09-21T01:48:38.131 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T01:48:38.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T01:48:38.237 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T01:48:38.237 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:38.237 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T01:48:38.253 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:38.253 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T01:48:38.308 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2024-09-21T01:48:38.309 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:38.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T01:48:38.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T01:48:38.384 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:48:38.384 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:48:38.440 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-09-21T01:48:38.440 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:48:38.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T01:48:38.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T01:48:38.475 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:48:38.475 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:48:38.530 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T01:48:38.530 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T01:48:38.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T01:48:38.591 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T01:48:38.594 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T01:48:38.659 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T01:48:38.662 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T01:48:38.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T01:48:38.724 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T01:48:38.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-21T01:48:38.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T01:48:38.854 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T01:48:38.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-21T01:48:38.883 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T01:48:38.943 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T01:48:38.946 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-21T01:48:38.971 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T01:48:39.071 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T01:48:39.074 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-21T01:48:39.098 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T01:48:39.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T01:48:39.151 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T01:48:39.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-21T01:48:39.216 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-21T01:48:39.230 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T01:48:39.280 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T01:48:39.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-21T01:48:39.343 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-21T01:48:39.356 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T01:48:39.356 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T01:48:39.356 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T01:48:39.381 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:39.381 INFO:tasks.ceph:role: osd.0 2024-09-21T01:48:39.381 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-21T01:48:39.381 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T01:48:39.453 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T01:48:39.453 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T01:48:39.454 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T01:48:39.454 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T01:48:39.454 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T01:48:39.454 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-21T01:48:39.454 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T01:48:39.454 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T01:48:39.454 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T01:48:39.454 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T01:48:39.963 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-21T01:48:39.965 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-21T01:48:39.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T01:48:40.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T01:48:40.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T01:48:40.196 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:40.196 INFO:tasks.ceph:role: osd.1 2024-09-21T01:48:40.197 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-21T01:48:40.197 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T01:48:40.271 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T01:48:40.271 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T01:48:40.272 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T01:48:40.272 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T01:48:40.272 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T01:48:40.272 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-21T01:48:40.272 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T01:48:40.272 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T01:48:40.272 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T01:48:40.272 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T01:48:40.715 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-21T01:48:40.717 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-21T01:48:40.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T01:48:40.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T01:48:40.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T01:48:40.904 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:40.905 INFO:tasks.ceph:role: osd.2 2024-09-21T01:48:40.905 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-21T01:48:40.905 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T01:48:40.978 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T01:48:40.978 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T01:48:40.978 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T01:48:40.978 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T01:48:40.978 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T01:48:40.978 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-21T01:48:40.978 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T01:48:40.978 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T01:48:40.978 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T01:48:40.979 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T01:48:41.458 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-21T01:48:41.460 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-21T01:48:41.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T01:48:41.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T01:48:41.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T01:48:41.702 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:41.702 INFO:tasks.ceph:role: osd.3 2024-09-21T01:48:41.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-21T01:48:41.702 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T01:48:41.776 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T01:48:42.295 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-21T01:48:42.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-21T01:48:42.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T01:48:42.421 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T01:48:42.455 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:48:42.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:42.563+0000 7f5b09a12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T01:48:42.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:42.564+0000 7f5b09a12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T01:48:42.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:42.564+0000 7f5b09a12640 -1 bdev(0x556e5ea9b900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T01:48:42.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:42.564+0000 7f5b09a12640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T01:48:45.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T01:48:45.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:48:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:45.613+0000 7f21df3b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T01:48:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:45.613+0000 7f21df3b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T01:48:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:45.613+0000 7f21df3b2640 -1 bdev(0x55b56cddd900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T01:48:45.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:45.614+0000 7f21df3b2640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T01:48:48.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T01:48:48.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:48:48.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:48.907+0000 7f7055e0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T01:48:48.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:48.907+0000 7f7055e0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T01:48:48.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:48.907+0000 7f7055e0d640 -1 bdev(0x558df8901900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T01:48:48.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:48.907+0000 7f7055e0d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T01:48:52.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T01:48:52.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:48:52.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:52.189+0000 7f7737a16640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T01:48:52.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:52.189+0000 7f7737a16640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T01:48:52.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:52.189+0000 7f7737a16640 -1 bdev(0x56144381f900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T01:48:52.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:48:52.189+0000 7f7737a16640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T01:48:55.098 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T01:48:55.129 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T01:48:55.159 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:55.159 INFO:tasks.ceph:role: osd.4 2024-09-21T01:48:55.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-21T01:48:55.159 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T01:48:55.235 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T01:48:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T01:48:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T01:48:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T01:48:55.235 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T01:48:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-21T01:48:55.235 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T01:48:55.235 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T01:48:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T01:48:55.236 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T01:48:55.756 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-21T01:48:55.758 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-21T01:48:55.759 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T01:48:55.888 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T01:48:55.922 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T01:48:55.990 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:55.990 INFO:tasks.ceph:role: osd.5 2024-09-21T01:48:55.991 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-21T01:48:55.991 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T01:48:56.066 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T01:48:56.523 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-21T01:48:56.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-21T01:48:56.525 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T01:48:56.614 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T01:48:56.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T01:48:56.713 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:56.714 INFO:tasks.ceph:role: osd.6 2024-09-21T01:48:56.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-21T01:48:56.714 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T01:48:56.788 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T01:48:56.788 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T01:48:56.788 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T01:48:56.788 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T01:48:56.788 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T01:48:56.789 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-21T01:48:56.789 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T01:48:56.789 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T01:48:56.789 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T01:48:56.789 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T01:48:57.282 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-21T01:48:57.284 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-21T01:48:57.284 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T01:48:57.402 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T01:48:57.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T01:48:57.502 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T01:48:57.503 INFO:tasks.ceph:role: osd.7 2024-09-21T01:48:57.503 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-21T01:48:57.503 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T01:48:57.577 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T01:48:58.099 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-21T01:48:58.101 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-21T01:48:58.101 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T01:48:58.228 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T01:48:58.261 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:48:58.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:48:58.368+0000 7f52d761e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T01:48:58.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:48:58.368+0000 7f52d761e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T01:48:58.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:48:58.368+0000 7f52d761e640 -1 bdev(0x56517d025900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T01:48:58.369 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:48:58.368+0000 7f52d761e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T01:49:01.793 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T01:49:01.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:49:01.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:01.924+0000 7fd3cf819640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T01:49:01.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:01.924+0000 7fd3cf819640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T01:49:01.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:01.924+0000 7fd3cf819640 -1 bdev(0x55da13e97900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T01:49:01.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:01.924+0000 7fd3cf819640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T01:49:05.088 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T01:49:05.117 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:49:05.219 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:05.219+0000 7f8ca50b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T01:49:05.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:05.219+0000 7f8ca50b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T01:49:05.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:05.219+0000 7f8ca50b2640 -1 bdev(0x562015025900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T01:49:05.220 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:05.220+0000 7f8ca50b2640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T01:49:06.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:49:06.107 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:49:08.135 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T01:49:08.164 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:49:08.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:08.266+0000 7fa921819640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T01:49:08.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:08.266+0000 7fa921819640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T01:49:08.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:08.266+0000 7fa921819640 -1 bdev(0x55708c869900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T01:49:08.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:08.267+0000 7fa921819640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T01:49:11.678 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T01:49:11.707 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T01:49:11.707 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:11.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T01:49:11.739 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:11.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-21T01:49:11.811 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:11.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-21T01:49:11.881 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:11.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T01:49:11.959 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:11.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T01:49:12.027 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:12.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T01:49:12.093 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:12.094 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T01:49:12.159 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:12.159 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T01:49:12.189 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:12.189 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-21T01:49:12.259 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:12.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-21T01:49:12.327 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:12.327 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T01:49:12.393 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:12.394 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T01:49:12.460 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:12.460 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T01:49:12.525 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:12.526 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T01:49:12.593 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:12.593 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T01:49:12.609 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:12.609 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-21T01:49:12.665 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:12.665 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T01:49:12.681 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:12.681 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-21T01:49:12.737 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T01:49:12.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T01:49:12.740 DEBUG:teuthology.orchestra.run.smithi139:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2Je5mc6dMIxAADRPrch7v0yVGrByQCNrhvw== 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2Je5mqGs1KxAAkvWSbpIqAd7AXhyqa6sRUA== 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2Je5mR2n8MhAAhRVm6iATASitlsJT0zjwdQ== 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD6Je5mqSKqIRAAHo4PFE6LadGp0bufxsoUvQ== 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD9Je5mDkmgJBAAxOJ/AnIH1KmM0/dJueNEIA== 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2024-09-21T01:49:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAAJu5m0TUfNhAAb0viIbYtQuPh3Bj2xcHJiA== 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAEJu5mlaBRCxAAXvhbOBydBeeV7PXW5tS83w== 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2Je5mw5NPJxAAnjFuL9hJP+q+jQaRguIZMQ== 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2Je5mHjZIOBAApQwg1vayW8v1Qd0vEkx5HQ== 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD3Je5miEBEBBAAEGWdgX4GQ83t2eaLvAgAaA== 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAKJu5mWb8EFhAA51gDu+3LHLLONS4rureOlA== 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQANJu5mxNMqNxAAtjwzkDVlb32k+oPD5wawtg== 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2024-09-21T01:49:12.782 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQARJu5mQ68cDRAA4V1HqPU7fszWYt/HXPuJaw== 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAUJu5mZT7rDxAAMESWJUIGIcvbJv+bdZH8yw== 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD3Je5mKd0UCRAATv+wqTRVwprFAiJ5ouQBFA== 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD3Je5moq3tDBAAaQ1F3LWs87oqZm3Hz8eCIA== 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD3Je5mN/jAEBAAKYlD6v4iOxgvE5/2BmiAtA== 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2024-09-21T01:49:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD3Je5mV4t8FBAA/2Nwj01ql2Hq2DJxnXk6Sg== 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.y] 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD2Je5mc6dMIxAADRPrch7v0yVGrByQCNrhvw== 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD2Je5mqGs1KxAAkvWSbpIqAd7AXhyqa6sRUA== 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD2Je5mR2n8MhAAhRVm6iATASitlsJT0zjwdQ== 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD6Je5mqSKqIRAAHo4PFE6LadGp0bufxsoUvQ== 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-09-21T01:49:12.801 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD9Je5mDkmgJBAAxOJ/AnIH1KmM0/dJueNEIA== 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAAJu5m0TUfNhAAb0viIbYtQuPh3Bj2xcHJiA== 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAEJu5mlaBRCxAAXvhbOBydBeeV7PXW5tS83w== 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.x] 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD2Je5mw5NPJxAAnjFuL9hJP+q+jQaRguIZMQ== 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD2Je5mHjZIOBAApQwg1vayW8v1Qd0vEkx5HQ== 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.d] 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD3Je5miEBEBBAAEGWdgX4GQ83t2eaLvAgAaA== 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.4] 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAKJu5mWb8EFhAA51gDu+3LHLLONS4rureOlA== 2024-09-21T01:49:12.802 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.5] 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQANJu5mxNMqNxAAtjwzkDVlb32k+oPD5wawtg== 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.6] 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQARJu5mQ68cDRAA4V1HqPU7fszWYt/HXPuJaw== 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.7] 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAUJu5mZT7rDxAAMESWJUIGIcvbJv+bdZH8yw== 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD3Je5mKd0UCRAATv+wqTRVwprFAiJ5ouQBFA== 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout:[client.2] 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD3Je5moq3tDBAAaQ1F3LWs87oqZm3Hz8eCIA== 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout:[client.1] 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD3Je5mN/jAEBAAKYlD6v4iOxgvE5/2BmiAtA== 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout:[client.3] 2024-09-21T01:49:12.803 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD3Je5mV4t8FBAA/2Nwj01ql2Hq2DJxnXk6Sg== 2024-09-21T01:49:12.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T01:49:12.827 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T01:49:12.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T01:49:12.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T01:49:12.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T01:49:12.976 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T01:49:13.041 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.043 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.107 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.170 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.234 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T01:49:13.297 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T01:49:13.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T01:49:13.360 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T01:49:13.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T01:49:13.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T01:49:13.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.493 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.556 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.620 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.683 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T01:49:13.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T01:49:13.747 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T01:49:13.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T01:49:13.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T01:49:13.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T01:49:13.880 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T01:49:13.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T01:49:13.946 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T01:49:14.011 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T01:49:14.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T01:49:14.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T01:49:14.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T01:49:14.170 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T01:49:14.195 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T01:49:14.304 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T01:49:14.328 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T01:49:14.393 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T01:49:14.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T01:49:14.525 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:49:14.528 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T01:49:14.580 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T01:49:14.581 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T01:49:14.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T01:49:14.584 INFO:tasks.ceph.mon.a:Started 2024-09-21T01:49:14.585 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T01:49:14.585 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T01:49:14.623 INFO:tasks.ceph.mon.b:Started 2024-09-21T01:49:14.623 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T01:49:14.623 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T01:49:14.625 INFO:tasks.ceph.mon.c:Started 2024-09-21T01:49:14.625 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T01:49:14.625 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T01:49:14.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T01:49:14.628 INFO:tasks.ceph.mgr.y:Started 2024-09-21T01:49:14.628 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T01:49:14.628 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T01:49:14.630 INFO:tasks.ceph.mgr.x:Started 2024-09-21T01:49:14.630 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-21T01:49:14.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-21T01:49:14.632 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-21T01:49:14.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-21T01:49:14.675 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-21T01:49:14.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-21T01:49:14.718 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-21T01:49:14.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-21T01:49:14.762 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-21T01:49:14.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-21T01:49:14.805 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-21T01:49:14.805 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-21T01:49:14.848 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-21T01:49:14.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-21T01:49:14.891 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-21T01:49:14.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-21T01:49:14.933 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-21T01:49:14.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-21T01:49:14.980 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-21T01:49:14.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-21T01:49:15.026 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-21T01:49:15.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-21T01:49:15.077 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-21T01:49:15.077 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-21T01:49:15.121 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-21T01:49:15.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-21T01:49:15.133 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T01:49:15.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-21T01:49:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.156+0000 7f368d7fa640 1 -- 172.21.15.40:0/303804071 <== mon.1 v2:172.21.15.139:3300/0 11 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v5)=0 v5) ==== 109+0+0 (secure 0 0 0) 0x7f367c03bae0 con 0x7f3690150540 2024-09-21T01:49:15.158 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T01:49:15.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-21T01:49:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.162+0000 7f3697207640 1 -- 172.21.15.40:0/303804071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3690150540 msgr2=0x7f36901f0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.162+0000 7f3697207640 1 --2- 172.21.15.40:0/303804071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3690150540 0x7f36901f0ea0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3680010100 tx=0x7f367c004730 comp rx=0 tx=0).stop 2024-09-21T01:49:15.166 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-21T01:49:15.166 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-21T01:49:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.163+0000 7f3697207640 1 -- 172.21.15.40:0/303804071 shutdown_connections 2024-09-21T01:49:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.163+0000 7f3697207640 1 --2- 172.21.15.40:0/303804071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36901e5b00 0x7f36900b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.163+0000 7f3697207640 1 --2- 172.21.15.40:0/303804071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3690150540 0x7f36901f0ea0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.163+0000 7f3697207640 1 --2- 172.21.15.40:0/303804071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3680003f90 0x7f369014ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.163+0000 7f3697207640 1 -- 172.21.15.40:0/303804071 >> 172.21.15.40:0/303804071 conn(0x7f36900cd480 msgr2=0x7f36900b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.163+0000 7f3697207640 1 -- 172.21.15.40:0/303804071 shutdown_connections 2024-09-21T01:49:15.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.163+0000 7f3697207640 1 -- 172.21.15.40:0/303804071 wait complete. 2024-09-21T01:49:15.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.178+0000 7faac7fff640 1 -- 172.21.15.40:0/1884513181 <== mon.0 v2:172.21.15.40:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7faad8038c80 con 0x7faae0159a70 2024-09-21T01:49:15.179 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.178+0000 7faac7fff640 1 -- 172.21.15.40:0/1884513181 <== mon.0 v2:172.21.15.40:3300/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faad804c440 con 0x7faae0159a70 2024-09-21T01:49:15.182 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-21T01:49:15.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-21T01:49:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.180+0000 7fa44a7fc640 1 -- 172.21.15.40:0/534123696 <== mon.0 v2:172.21.15.40:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa450020470 con 0x7fa454070e80 2024-09-21T01:49:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.183+0000 7f40617fa640 1 -- 172.21.15.40:0/1120084966 <== mon.2 v2:172.21.15.139:3301/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40640c0460 con 0x7f405c0e7410 2024-09-21T01:49:15.185 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-21T01:49:15.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-21T01:49:15.193 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-21T01:49:15.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-21T01:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.190+0000 7faac5ffb640 1 -- 172.21.15.40:0/1884513181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faae0159a70 msgr2=0x7faae0159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.190+0000 7faac5ffb640 1 --2- 172.21.15.40:0/1884513181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faae0159a70 0x7faae0159e80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faad802aa30 tx=0x7faad8004a40 comp rx=0 tx=0).stop 2024-09-21T01:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.190+0000 7faac5ffb640 1 -- 172.21.15.40:0/1884513181 shutdown_connections 2024-09-21T01:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.190+0000 7faac5ffb640 1 --2- 172.21.15.40:0/1884513181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faae0159a70 0x7faae0159e80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.190+0000 7faac5ffb640 1 --2- 172.21.15.40:0/1884513181 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faae0158340 0x7faae015afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.191+0000 7faac5ffb640 1 --2- 172.21.15.40:0/1884513181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faae0074420 0x7faae01f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.191+0000 7faac5ffb640 1 -- 172.21.15.40:0/1884513181 >> 172.21.15.40:0/1884513181 conn(0x7faae006def0 msgr2=0x7faae0154fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.194+0000 7faac5ffb640 1 -- 172.21.15.40:0/1884513181 shutdown_connections 2024-09-21T01:49:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.197+0000 7faac5ffb640 1 -- 172.21.15.40:0/1884513181 wait complete. 2024-09-21T01:49:15.199 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T01:49:15.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T01:49:15.231 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-21T01:49:15.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-21T01:49:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.237+0000 7f958759e640 1 -- 172.21.15.40:0/1300366429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 msgr2=0x7f95880cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.238+0000 7f958759e640 1 --2- 172.21.15.40:0/1300366429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 0x7f95880cfd10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f95880cf7f0 tx=0x7f957802a5a0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.240 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-21T01:49:15.240 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-21T01:49:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.240+0000 7f958759e640 1 -- 172.21.15.40:0/1300366429 shutdown_connections 2024-09-21T01:49:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.240+0000 7f958759e640 1 --2- 172.21.15.40:0/1300366429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 0x7f95880cfd10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.240+0000 7f958759e640 1 --2- 172.21.15.40:0/1300366429 >> v2:172.21.15.139:3300/0 conn(0x7f95880d0250 0x7f95880d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.240+0000 7f958759e640 1 --2- 172.21.15.40:0/1300366429 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95880b9540 0x7f95880d4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.240+0000 7f958759e640 1 -- 172.21.15.40:0/1300366429 >> 172.21.15.40:0/1300366429 conn(0x7f958809d680 msgr2=0x7f95880d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.240+0000 7f958759e640 1 -- 172.21.15.40:0/1300366429 shutdown_connections 2024-09-21T01:49:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.240+0000 7f958759e640 1 -- 172.21.15.40:0/1300366429 wait complete. 2024-09-21T01:49:15.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.244+0000 7f958759e640 1 Processor -- start 2024-09-21T01:49:15.250 DEBUG:tasks.ceph:set 22 configs 2024-09-21T01:49:15.250 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.250 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.251 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.251 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.251 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.251 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.244+0000 7f958759e640 1 -- start start 2024-09-21T01:49:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.246+0000 7f958759e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 0x7f958815e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f958659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 0x7f958815e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f958659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 0x7f958815e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38448/0 (socket says 172.21.15.40:38448) 2024-09-21T01:49:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f958659c640 1 -- 172.21.15.40:0/48356762 learned_addr learned my addr 172.21.15.40:0/48356762 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f958759e640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95880b9540 0x7f95880a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f958759e640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95880d0250 0x7f95880cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f95880d1500 con 0x7f95880b3660 2024-09-21T01:49:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f95880d1380 con 0x7f95880d0250 2024-09-21T01:49:15.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f95880b3ca0 con 0x7f95880b9540 2024-09-21T01:49:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f9586d9d640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95880d0250 0x7f95880cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.247+0000 7f9585d9b640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95880b9540 0x7f95880a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.248+0000 7f9586d9d640 1 -- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95880b9540 msgr2=0x7f95880a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.248+0000 7f9586d9d640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95880b9540 0x7f95880a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.248+0000 7f9586d9d640 1 -- 172.21.15.40:0/48356762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 msgr2=0x7f958815e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.248+0000 7f9586d9d640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 0x7f958815e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.248+0000 7f9586d9d640 1 -- 172.21.15.40:0/48356762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95881f96e0 con 0x7f95880d0250 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.249+0000 7f9586d9d640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95880d0250 0x7f95880cd350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f958000bdf0 tx=0x7f9580009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.250+0000 7f957effd640 1 -- 172.21.15.40:0/48356762 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580019070 con 0x7f95880d0250 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.250+0000 7f957effd640 1 -- 172.21.15.40:0/48356762 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9580014440 con 0x7f95880d0250 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.250+0000 7f957effd640 1 -- 172.21.15.40:0/48356762 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580014890 con 0x7f95880d0250 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.251+0000 7f958659c640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 0x7f958815e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.253+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95881f99c0 con 0x7f95880d0250 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.253+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95881f9f80 con 0x7f95880d0250 2024-09-21T01:49:15.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.254+0000 7f957effd640 1 -- 172.21.15.40:0/48356762 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f958001c070 con 0x7f95880d0250 2024-09-21T01:49:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.254+0000 7f957effd640 1 -- 172.21.15.40:0/48356762 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f958001ece0 con 0x7f95880d0250 2024-09-21T01:49:15.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.255+0000 7f957cff9640 1 -- 172.21.15.40:0/48356762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95880d4ee0 con 0x7f95880d0250 2024-09-21T01:49:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.262+0000 7f957effd640 1 -- 172.21.15.40:0/48356762 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9580014ad0 con 0x7f95880d0250 2024-09-21T01:49:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.292+0000 7f00f57ba640 1 -- 172.21.15.40:0/1849489740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0162590 msgr2=0x7f00f01629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.292+0000 7f00f57ba640 1 --2- 172.21.15.40:0/1849489740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0162590 0x7f00f01629a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f00f006ecb0 tx=0x7f00e002a340 comp rx=0 tx=0).stop 2024-09-21T01:49:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.306+0000 7f00f57ba640 1 -- 172.21.15.40:0/1849489740 shutdown_connections 2024-09-21T01:49:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.306+0000 7f00f57ba640 1 --2- 172.21.15.40:0/1849489740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0162590 0x7f00f01629a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.306+0000 7f00f57ba640 1 --2- 172.21.15.40:0/1849489740 >> v2:172.21.15.139:3300/0 conn(0x7f00f0074db0 0x7f00f015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.306+0000 7f00f57ba640 1 -- 172.21.15.40:0/1849489740 >> 172.21.15.40:0/1849489740 conn(0x7f00f0074220 msgr2=0x7f00f0074630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.306+0000 7f00f57ba640 1 -- 172.21.15.40:0/1849489740 shutdown_connections 2024-09-21T01:49:15.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.306+0000 7f00f57ba640 1 -- 172.21.15.40:0/1849489740 wait complete. 2024-09-21T01:49:15.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.309+0000 7f00f57ba640 1 Processor -- start 2024-09-21T01:49:15.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.310+0000 7f00f57ba640 1 -- start start 2024-09-21T01:49:15.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.312+0000 7f00f57ba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0074db0 0x7f00f0201f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.313+0000 7f00eeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0074db0 0x7f00f0201f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.313+0000 7f00eeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0074db0 0x7f00f0201f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38466/0 (socket says 172.21.15.40:38466) 2024-09-21T01:49:15.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.313+0000 7f00eeffd640 1 -- 172.21.15.40:0/2289730921 learned_addr learned my addr 172.21.15.40:0/2289730921 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.313+0000 7f00f57ba640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00f00b11f0 0x7f00f00ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.313+0000 7f00f57ba640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f00f0162590 0x7f00f0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.313+0000 7f00ee7fc640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00f00b11f0 0x7f00f00ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.313+0000 7f00effff640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f00f0162590 0x7f00f0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.314+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f00f015ed00 con 0x7f00f0074db0 2024-09-21T01:49:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.314+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f00f0163260 con 0x7f00f00b11f0 2024-09-21T01:49:15.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.314+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f00f015ee80 con 0x7f00f0162590 2024-09-21T01:49:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.314+0000 7f00eeffd640 1 -- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f00f0162590 msgr2=0x7f00f0152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.314+0000 7f00eeffd640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f00f0162590 0x7f00f0152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.314+0000 7f00eeffd640 1 -- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00f00b11f0 msgr2=0x7f00f00ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.314+0000 7f00eeffd640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00f00b11f0 0x7f00f00ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.314+0000 7f00eeffd640 1 -- 172.21.15.40:0/2289730921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f014cfd0 con 0x7f00f0074db0 2024-09-21T01:49:15.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.315+0000 7f00eeffd640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0074db0 0x7f00f0201f20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f00e400d9f0 tx=0x7f00e400deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.315+0000 7f00effff640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f00f0162590 0x7f00f0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:15.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.316+0000 7f00ee7fc640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00f00b11f0 0x7f00f00ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:15.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.316+0000 7f00d77fe640 1 -- 172.21.15.40:0/2289730921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4017070 con 0x7f00f0074db0 2024-09-21T01:49:15.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.316+0000 7f00d77fe640 1 -- 172.21.15.40:0/2289730921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00e4004310 con 0x7f00f0074db0 2024-09-21T01:49:15.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.316+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f014d2b0 con 0x7f00f0074db0 2024-09-21T01:49:15.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.316+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f0202460 con 0x7f00f0074db0 2024-09-21T01:49:15.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.317+0000 7f00d77fe640 1 -- 172.21.15.40:0/2289730921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4009b40 con 0x7f00f0074db0 2024-09-21T01:49:15.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.318+0000 7f00d77fe640 1 -- 172.21.15.40:0/2289730921 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f00e4009ce0 con 0x7f00f0074db0 2024-09-21T01:49:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.319+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d0005290 con 0x7f00f0074db0 2024-09-21T01:49:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.330+0000 7f00d77fe640 1 -- 172.21.15.40:0/2289730921 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f00e4010810 con 0x7f00f0074db0 2024-09-21T01:49:15.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.337+0000 7f00d77fe640 1 -- 172.21.15.40:0/2289730921 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f00e4010ae0 con 0x7f00f0074db0 2024-09-21T01:49:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.359+0000 7f6264513640 1 -- 172.21.15.40:0/1977076743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 msgr2=0x7f625c15f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.359+0000 7f6264513640 1 --2- 172.21.15.40:0/1977076743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 0x7f625c15f9b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6258009830 tx=0x7f625802a410 comp rx=0 tx=0).stop 2024-09-21T01:49:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.359+0000 7f6264513640 1 -- 172.21.15.40:0/1977076743 shutdown_connections 2024-09-21T01:49:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.359+0000 7f6264513640 1 --2- 172.21.15.40:0/1977076743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 0x7f625c15f9b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.359+0000 7f6264513640 1 --2- 172.21.15.40:0/1977076743 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f625c06f660 0x7f625c070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.359+0000 7f6264513640 1 -- 172.21.15.40:0/1977076743 >> 172.21.15.40:0/1977076743 conn(0x7f625c0cd4b0 msgr2=0x7f625c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.360+0000 7f6264513640 1 -- 172.21.15.40:0/1977076743 shutdown_connections 2024-09-21T01:49:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.360+0000 7f6264513640 1 -- 172.21.15.40:0/1977076743 wait complete. 2024-09-21T01:49:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.363+0000 7f6264513640 1 Processor -- start 2024-09-21T01:49:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.363+0000 7f6264513640 1 -- start start 2024-09-21T01:49:15.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.365+0000 7f6264513640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f625c06f660 0x7f625c0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.366+0000 7f6264513640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f625c0b0010 0x7f625c158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.366+0000 7f6264513640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 0x7f625c0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.366+0000 7f6261aae640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f625c0b0010 0x7f625c158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.366+0000 7f6261aae640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f625c0b0010 0x7f625c158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:43172/0 (socket says 172.21.15.40:43172) 2024-09-21T01:49:15.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.367+0000 7f6262ab0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 0x7f625c0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.367+0000 7f6262ab0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 0x7f625c0aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38480/0 (socket says 172.21.15.40:38480) 2024-09-21T01:49:15.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.367+0000 7f6261aae640 1 -- 172.21.15.40:0/235331245 learned_addr learned my addr 172.21.15.40:0/235331245 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.367+0000 7f6264513640 1 -- 172.21.15.40:0/235331245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f625c06d170 con 0x7f625c15f5a0 2024-09-21T01:49:15.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.367+0000 7f6264513640 1 -- 172.21.15.40:0/235331245 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f625c06cff0 con 0x7f625c06f660 2024-09-21T01:49:15.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.367+0000 7f6264513640 1 -- 172.21.15.40:0/235331245 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f625c06d2f0 con 0x7f625c0b0010 2024-09-21T01:49:15.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.373+0000 7f62622af640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f625c06f660 0x7f625c0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.375+0000 7f6261aae640 1 -- 172.21.15.40:0/235331245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f625c06f660 msgr2=0x7f625c0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.375+0000 7f6261aae640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f625c06f660 0x7f625c0b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.375+0000 7f6261aae640 1 -- 172.21.15.40:0/235331245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 msgr2=0x7f625c0aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.375+0000 7f6261aae640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 0x7f625c0aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.375+0000 7f6261aae640 1 -- 172.21.15.40:0/235331245 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c1f9970 con 0x7f625c0b0010 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.376+0000 7f6261aae640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f625c0b0010 0x7f625c158f30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f624c00b390 tx=0x7f624c00b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.376+0000 7f6262ab0640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 0x7f625c0aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.376+0000 7f62622af640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f625c06f660 0x7f625c0b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.376+0000 7f6252ffd640 1 -- 172.21.15.40:0/235331245 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c015020 con 0x7f625c0b0010 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.377+0000 7f6252ffd640 1 -- 172.21.15.40:0/235331245 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f624c011920 con 0x7f625c0b0010 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.377+0000 7f6264513640 1 -- 172.21.15.40:0/235331245 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625c1f9c50 con 0x7f625c0b0010 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.377+0000 7f6264513640 1 -- 172.21.15.40:0/235331245 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f625c1fa210 con 0x7f625c0b0010 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.378+0000 7f6252ffd640 1 -- 172.21.15.40:0/235331245 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c011d70 con 0x7f625c0b0010 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.379+0000 7f6252ffd640 1 -- 172.21.15.40:0/235331245 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f624c018020 con 0x7f625c0b0010 2024-09-21T01:49:15.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.379+0000 7f6252ffd640 1 -- 172.21.15.40:0/235331245 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f624c019b70 con 0x7f625c0b0010 2024-09-21T01:49:15.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.380+0000 7f6264513640 1 -- 172.21.15.40:0/235331245 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6244005290 con 0x7f625c0b0010 2024-09-21T01:49:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.394+0000 7f6252ffd640 1 -- 172.21.15.40:0/235331245 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f624c01f020 con 0x7f625c0b0010 2024-09-21T01:49:15.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.403+0000 7fa45bd20640 1 -- 172.21.15.40:0/534123696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fa4300052f0 con 0x7fa454070e80 2024-09-21T01:49:15.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.412+0000 7fa44a7fc640 1 -- 172.21.15.40:0/534123696 <== mon.0 v2:172.21.15.40:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7fa450026080 con 0x7fa454070e80 2024-09-21T01:49:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.419+0000 7fa45bd20640 1 -- 172.21.15.40:0/534123696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa454070e80 msgr2=0x7fa4540c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.419+0000 7fa45bd20640 1 --2- 172.21.15.40:0/534123696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa454070e80 0x7fa4540c5440 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa45000b390 tx=0x7fa45000b850 comp rx=0 tx=0).stop 2024-09-21T01:49:15.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.419+0000 7fa45bd20640 1 -- 172.21.15.40:0/534123696 shutdown_connections 2024-09-21T01:49:15.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.419+0000 7fa45bd20640 1 --2- 172.21.15.40:0/534123696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4540b26a0 0x7fa4540c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.419+0000 7fa45bd20640 1 --2- 172.21.15.40:0/534123696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa454070e80 0x7fa4540c5440 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.419+0000 7fa45bd20640 1 --2- 172.21.15.40:0/534123696 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa4540700f0 0x7fa454147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.419+0000 7fa45bd20640 1 -- 172.21.15.40:0/534123696 >> 172.21.15.40:0/534123696 conn(0x7fa4540ccfa0 msgr2=0x7fa45415b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.423+0000 7fa45bd20640 1 -- 172.21.15.40:0/534123696 shutdown_connections 2024-09-21T01:49:15.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.423+0000 7fa45bd20640 1 -- 172.21.15.40:0/534123696 wait complete. 2024-09-21T01:49:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.429+0000 7f4069e52640 1 -- 172.21.15.40:0/1120084966 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f40440016f0 con 0x7f405c0e7410 2024-09-21T01:49:15.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.440+0000 7f40617fa640 1 -- 172.21.15.40:0/1120084966 <== mon.2 v2:172.21.15.139:3301/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f40640c7030 con 0x7f405c0e7410 2024-09-21T01:49:15.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.444+0000 7f4069e52640 1 -- 172.21.15.40:0/1120084966 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f405c0e7410 msgr2=0x7f405c0317d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.444+0000 7f4069e52640 1 --2- 172.21.15.40:0/1120084966 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f405c0e7410 0x7f405c0317d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40640759c0 tx=0x7f406406b3a0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.444+0000 7f4069e52640 1 -- 172.21.15.40:0/1120084966 shutdown_connections 2024-09-21T01:49:15.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.444+0000 7f4069e52640 1 --2- 172.21.15.40:0/1120084966 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f405c0e7410 0x7f405c0317d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.444+0000 7f4069e52640 1 --2- 172.21.15.40:0/1120084966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f405c0e7000 0x7f405c031290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.444+0000 7f4069e52640 1 --2- 172.21.15.40:0/1120084966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f405c052360 0x7f405c185450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.444+0000 7f4069e52640 1 -- 172.21.15.40:0/1120084966 >> 172.21.15.40:0/1120084966 conn(0x7f405c01d9a0 msgr2=0x7f405c0e0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.445+0000 7f4069e52640 1 -- 172.21.15.40:0/1120084966 shutdown_connections 2024-09-21T01:49:15.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.445+0000 7f4069e52640 1 -- 172.21.15.40:0/1120084966 wait complete. 2024-09-21T01:49:15.458 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.472 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.485+0000 7f3973eec640 1 -- 172.21.15.40:0/1274199567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 msgr2=0x7f396c0d04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.493+0000 7f3973eec640 1 --2- 172.21.15.40:0/1274199567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 0x7f396c0d04c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3964005fd0 tx=0x7f396402a960 comp rx=0 tx=0).stop 2024-09-21T01:49:15.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.505+0000 7f3973eec640 1 -- 172.21.15.40:0/1274199567 shutdown_connections 2024-09-21T01:49:15.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.505+0000 7f3973eec640 1 --2- 172.21.15.40:0/1274199567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 0x7f396c0d04c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.505+0000 7f3973eec640 1 -- 172.21.15.40:0/1274199567 >> 172.21.15.40:0/1274199567 conn(0x7f396c072aa0 msgr2=0x7f396c072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.505+0000 7f3973eec640 1 -- 172.21.15.40:0/1274199567 shutdown_connections 2024-09-21T01:49:15.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.505+0000 7f3973eec640 1 -- 172.21.15.40:0/1274199567 wait complete. 2024-09-21T01:49:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.509+0000 7f3973eec640 1 Processor -- start 2024-09-21T01:49:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.509+0000 7f3973eec640 1 -- start start 2024-09-21T01:49:15.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.512+0000 7f3973eec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 0x7f396c13fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.528+0000 7f3973eec640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396c0d0a00 0x7f396c161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.528+0000 7f3971c88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 0x7f396c13fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.528+0000 7f3971c88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 0x7f396c13fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38492/0 (socket says 172.21.15.40:38492) 2024-09-21T01:49:15.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.528+0000 7f3973eec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f396c0d2900 0x7f396c161790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.528+0000 7f3971487640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396c0d0a00 0x7f396c161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.529+0000 7f3971487640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396c0d0a00 0x7f396c161250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:43180/0 (socket says 172.21.15.40:43180) 2024-09-21T01:49:15.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.529+0000 7f3971487640 1 -- 172.21.15.40:0/636510151 learned_addr learned my addr 172.21.15.40:0/636510151 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.529+0000 7f3972489640 1 --2- 172.21.15.40:0/636510151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f396c0d2900 0x7f396c161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.529+0000 7f3973eec640 1 -- 172.21.15.40:0/636510151 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f396c15d250 con 0x7f396c0cf880 2024-09-21T01:49:15.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.529+0000 7f3973eec640 1 -- 172.21.15.40:0/636510151 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f396c15d0d0 con 0x7f396c0d2900 2024-09-21T01:49:15.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.529+0000 7f3973eec640 1 -- 172.21.15.40:0/636510151 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f396c15d3d0 con 0x7f396c0d0a00 2024-09-21T01:49:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.530+0000 7f3971487640 1 -- 172.21.15.40:0/636510151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f396c0d2900 msgr2=0x7f396c161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.530+0000 7f3971487640 1 --2- 172.21.15.40:0/636510151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f396c0d2900 0x7f396c161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.530+0000 7f3971487640 1 -- 172.21.15.40:0/636510151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 msgr2=0x7f396c13fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.530+0000 7f3971487640 1 --2- 172.21.15.40:0/636510151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 0x7f396c13fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.530+0000 7f3971487640 1 -- 172.21.15.40:0/636510151 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c140480 con 0x7f396c0d0a00 2024-09-21T01:49:15.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.530+0000 7f3971487640 1 --2- 172.21.15.40:0/636510151 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396c0d0a00 0x7f396c161250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f396000c430 tx=0x7f396000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.530+0000 7f395e7fc640 1 -- 172.21.15.40:0/636510151 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960011790 con 0x7f396c0d0a00 2024-09-21T01:49:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.531+0000 7f395e7fc640 1 -- 172.21.15.40:0/636510151 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3960017070 con 0x7f396c0d0a00 2024-09-21T01:49:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.531+0000 7f3973eec640 1 -- 172.21.15.40:0/636510151 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c140760 con 0x7f396c0d0a00 2024-09-21T01:49:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.531+0000 7f3973eec640 1 -- 172.21.15.40:0/636510151 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c140d20 con 0x7f396c0d0a00 2024-09-21T01:49:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.533+0000 7f3971c88640 1 --2- 172.21.15.40:0/636510151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 0x7f396c13fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T01:49:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.533+0000 7f395e7fc640 1 -- 172.21.15.40:0/636510151 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960011c80 con 0x7f396c0d0a00 2024-09-21T01:49:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.533+0000 7f395e7fc640 1 -- 172.21.15.40:0/636510151 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f396001c460 con 0x7f396c0d0a00 2024-09-21T01:49:15.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.533+0000 7f395e7fc640 1 -- 172.21.15.40:0/636510151 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39600129c0 con 0x7f396c0d0a00 2024-09-21T01:49:15.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.542+0000 7f3957fff640 1 -- 172.21.15.40:0/636510151 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394c005290 con 0x7f396c0d0a00 2024-09-21T01:49:15.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.549+0000 7f395e7fc640 1 -- 172.21.15.40:0/636510151 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3960011e20 con 0x7f396c0d0a00 2024-09-21T01:49:15.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.547+0000 7f49d964d640 1 -- 172.21.15.40:0/1559831628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49d40cb180 msgr2=0x7f49d4072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.547+0000 7f49d964d640 1 --2- 172.21.15.40:0/1559831628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49d40cb180 0x7f49d4072e30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f49c400afc0 tx=0x7f49c402e840 comp rx=0 tx=0).stop 2024-09-21T01:49:15.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.547+0000 7f49d964d640 1 -- 172.21.15.40:0/1559831628 shutdown_connections 2024-09-21T01:49:15.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.548+0000 7f49d964d640 1 --2- 172.21.15.40:0/1559831628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49d40cb180 0x7f49d4072e30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.548+0000 7f49d964d640 1 -- 172.21.15.40:0/1559831628 >> 172.21.15.40:0/1559831628 conn(0x7f49d40b20a0 msgr2=0x7f49d40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.548+0000 7f49d964d640 1 -- 172.21.15.40:0/1559831628 shutdown_connections 2024-09-21T01:49:15.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.548+0000 7f49d964d640 1 -- 172.21.15.40:0/1559831628 wait complete. 2024-09-21T01:49:15.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.551+0000 7f49d964d640 1 Processor -- start 2024-09-21T01:49:15.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.551+0000 7f49d964d640 1 -- start start 2024-09-21T01:49:15.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.553+0000 7f49d964d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49d408b140 0x7f49d40b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d964d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49d4209dc0 0x7f49d416e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d964d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49d420a1d0 0x7f49d416e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d2ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49d408b140 0x7f49d40b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d2ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49d408b140 0x7f49d40b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.40:45212/0 (socket says 172.21.15.40:45212) 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d27fc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49d4209dc0 0x7f49d416e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d27fc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49d4209dc0 0x7f49d416e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:43194/0 (socket says 172.21.15.40:43194) 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d2ffd640 1 -- 172.21.15.40:0/2603076495 learned_addr learned my addr 172.21.15.40:0/2603076495 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f49d40cfb00 con 0x7f49d420a1d0 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f49d4075130 con 0x7f49d408b140 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f49d40cfc80 con 0x7f49d4209dc0 2024-09-21T01:49:15.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.558+0000 7f49d37fe640 1 --2- 172.21.15.40:0/2603076495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49d420a1d0 0x7f49d416e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.559+0000 7f49d37fe640 1 -- 172.21.15.40:0/2603076495 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49d4209dc0 msgr2=0x7f49d416e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.559+0000 7f49d37fe640 1 --2- 172.21.15.40:0/2603076495 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49d4209dc0 0x7f49d416e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.559+0000 7f49d37fe640 1 -- 172.21.15.40:0/2603076495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49d408b140 msgr2=0x7f49d40b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.559+0000 7f49d37fe640 1 --2- 172.21.15.40:0/2603076495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49d408b140 0x7f49d40b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.559+0000 7f49d37fe640 1 -- 172.21.15.40:0/2603076495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d41f67c0 con 0x7f49d420a1d0 2024-09-21T01:49:15.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.559+0000 7f49d37fe640 1 --2- 172.21.15.40:0/2603076495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49d420a1d0 0x7f49d416e9a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49c800b3e0 tx=0x7f49c800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.559+0000 7f73291ce640 1 -- 172.21.15.40:0/863263374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731c0e71d0 msgr2=0x7f731c005de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.559+0000 7f73291ce640 1 --2- 172.21.15.40:0/863263374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731c0e71d0 0x7f731c005de0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f731c04b7f0 tx=0x7f731802a290 comp rx=0 tx=0).stop 2024-09-21T01:49:15.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.560+0000 7f49bb7fe640 1 -- 172.21.15.40:0/2603076495 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8015020 con 0x7f49d420a1d0 2024-09-21T01:49:15.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.560+0000 7f49bb7fe640 1 -- 172.21.15.40:0/2603076495 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49c8011940 con 0x7f49d420a1d0 2024-09-21T01:49:15.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.560+0000 7f49bb7fe640 1 -- 172.21.15.40:0/2603076495 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8011d90 con 0x7f49d420a1d0 2024-09-21T01:49:15.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.560+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d41f6200 con 0x7f49d420a1d0 2024-09-21T01:49:15.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.560+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d40b3050 con 0x7f49d420a1d0 2024-09-21T01:49:15.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.561+0000 7f49bb7fe640 1 -- 172.21.15.40:0/2603076495 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f49c8018020 con 0x7f49d420a1d0 2024-09-21T01:49:15.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.561+0000 7f49bb7fe640 1 -- 172.21.15.40:0/2603076495 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f49c80198d0 con 0x7f49d420a1d0 2024-09-21T01:49:15.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.563+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b4005290 con 0x7f49d420a1d0 2024-09-21T01:49:15.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.563+0000 7f73291ce640 1 -- 172.21.15.40:0/863263374 shutdown_connections 2024-09-21T01:49:15.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.563+0000 7f73291ce640 1 --2- 172.21.15.40:0/863263374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731c0e71d0 0x7f731c005de0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.563+0000 7f73291ce640 1 -- 172.21.15.40:0/863263374 >> 172.21.15.40:0/863263374 conn(0x7f731c01d9a0 msgr2=0x7f731c039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.566+0000 7f73291ce640 1 -- 172.21.15.40:0/863263374 shutdown_connections 2024-09-21T01:49:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.567+0000 7f49bb7fe640 1 -- 172.21.15.40:0/2603076495 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f49c801f020 con 0x7f49d420a1d0 2024-09-21T01:49:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.567+0000 7f73291ce640 1 -- 172.21.15.40:0/863263374 wait complete. 2024-09-21T01:49:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.570+0000 7f73291ce640 1 Processor -- start 2024-09-21T01:49:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.571+0000 7f73291ce640 1 -- start start 2024-09-21T01:49:15.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.573+0000 7f73291ce640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f731c006320 0x7f731c187ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.573+0000 7f73291ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f731c052360 0x7f731c0e0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.574+0000 7f7323fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f731c006320 0x7f731c187ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.574+0000 7f7323fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f731c006320 0x7f731c187ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:43200/0 (socket says 172.21.15.40:43200) 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.574+0000 7f7323fff640 1 -- 172.21.15.40:0/107360376 learned_addr learned my addr 172.21.15.40:0/107360376 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.574+0000 7f73291ce640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731c0e71d0 0x7f731c0e0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.574+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f731c006730 con 0x7f731c0e71d0 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.574+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f731c0e3620 con 0x7f731c052360 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.574+0000 7f73289cd640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731c0e71d0 0x7f731c0e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.574+0000 7f73237fe640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f731c052360 0x7f731c0e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.574+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f731c0068b0 con 0x7f731c006320 2024-09-21T01:49:15.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.579+0000 7f7323fff640 1 -- 172.21.15.40:0/107360376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f731c052360 msgr2=0x7f731c0e0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.579+0000 7f7323fff640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f731c052360 0x7f731c0e0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.579+0000 7f7323fff640 1 -- 172.21.15.40:0/107360376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731c0e71d0 msgr2=0x7f731c0e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.579+0000 7f7323fff640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731c0e71d0 0x7f731c0e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.579+0000 7f7323fff640 1 -- 172.21.15.40:0/107360376 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731c04fca0 con 0x7f731c006320 2024-09-21T01:49:15.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.587+0000 7f7323fff640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f731c006320 0x7f731c187ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f731000b410 tx=0x7f731000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.591+0000 7f7320ff9640 1 -- 172.21.15.40:0/107360376 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310015020 con 0x7f731c006320 2024-09-21T01:49:15.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.591+0000 7f7320ff9640 1 -- 172.21.15.40:0/107360376 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7310011830 con 0x7f731c006320 2024-09-21T01:49:15.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.591+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f731c1881c0 con 0x7f731c006320 2024-09-21T01:49:15.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.591+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f731c188780 con 0x7f731c006320 2024-09-21T01:49:15.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.591+0000 7f7320ff9640 1 -- 172.21.15.40:0/107360376 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310011c80 con 0x7f731c006320 2024-09-21T01:49:15.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.591+0000 7f7320ff9640 1 -- 172.21.15.40:0/107360376 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7310018020 con 0x7f731c006320 2024-09-21T01:49:15.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.591+0000 7f7320ff9640 1 -- 172.21.15.40:0/107360376 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f731001a4c0 con 0x7f731c006320 2024-09-21T01:49:15.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.594+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7304005290 con 0x7f731c006320 2024-09-21T01:49:15.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.598+0000 7f7320ff9640 1 -- 172.21.15.40:0/107360376 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7310011e20 con 0x7f731c006320 2024-09-21T01:49:15.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.599+0000 7fd8190d5640 1 -- 172.21.15.40:0/4220914284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140cac60 msgr2=0x7fd8140cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.599+0000 7fd8190d5640 1 --2- 172.21.15.40:0/4220914284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140cac60 0x7fd8140cb070 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd8140cbd50 tx=0x7fd80c02ba80 comp rx=0 tx=0).stop 2024-09-21T01:49:15.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.600+0000 7fd8190d5640 1 -- 172.21.15.40:0/4220914284 shutdown_connections 2024-09-21T01:49:15.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.600+0000 7fd8190d5640 1 --2- 172.21.15.40:0/4220914284 >> v2:172.21.15.139:3300/0 conn(0x7fd8140cc630 0x7fd8140cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.600+0000 7fd8190d5640 1 --2- 172.21.15.40:0/4220914284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140cac60 0x7fd8140cb070 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.600+0000 7fd8190d5640 1 -- 172.21.15.40:0/4220914284 >> 172.21.15.40:0/4220914284 conn(0x7fd81406d5d0 msgr2=0x7fd81406ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.601+0000 7fa1d3307640 1 -- 172.21.15.40:0/623403746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1c40070e0 msgr2=0x7fa1c4053860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.601+0000 7fa1d3307640 1 --2- 172.21.15.40:0/623403746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1c40070e0 0x7fa1c4053860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc007380 tx=0x7fa1bc02b040 comp rx=0 tx=0).stop 2024-09-21T01:49:15.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.601+0000 7fa1d3307640 1 -- 172.21.15.40:0/623403746 shutdown_connections 2024-09-21T01:49:15.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.601+0000 7fa1d3307640 1 --2- 172.21.15.40:0/623403746 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1c40070e0 0x7fa1c4053860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.601+0000 7fa1d3307640 1 -- 172.21.15.40:0/623403746 >> 172.21.15.40:0/623403746 conn(0x7fa1c401d9d0 msgr2=0x7fa1c4039690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.601+0000 7f957cff9640 1 -- 172.21.15.40:0/48356762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f958806dfc0 con 0x7f95880d0250 2024-09-21T01:49:15.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.603+0000 7fca61d71640 1 -- 172.21.15.40:0/1878060557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca540e71d0 msgr2=0x7fca54005de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.603+0000 7fca61d71640 1 --2- 172.21.15.40:0/1878060557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca540e71d0 0x7fca54005de0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fca5c06af90 tx=0x7fca5c0a6600 comp rx=0 tx=0).stop 2024-09-21T01:49:15.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.603+0000 7fca61d71640 1 -- 172.21.15.40:0/1878060557 shutdown_connections 2024-09-21T01:49:15.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.603+0000 7fca61d71640 1 --2- 172.21.15.40:0/1878060557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca540e71d0 0x7fca54005de0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.603+0000 7fca61d71640 1 -- 172.21.15.40:0/1878060557 >> 172.21.15.40:0/1878060557 conn(0x7fca5401d9a0 msgr2=0x7fca54039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.603+0000 7fca61d71640 1 -- 172.21.15.40:0/1878060557 shutdown_connections 2024-09-21T01:49:15.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.603+0000 7fca61d71640 1 -- 172.21.15.40:0/1878060557 wait complete. 2024-09-21T01:49:15.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.606+0000 7fca61d71640 1 Processor -- start 2024-09-21T01:49:15.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.607+0000 7f957effd640 1 -- 172.21.15.40:0/48356762 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f9580014d80 con 0x7f95880d0250 2024-09-21T01:49:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.600+0000 7fd8190d5640 1 -- 172.21.15.40:0/4220914284 shutdown_connections 2024-09-21T01:49:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.600+0000 7fd8190d5640 1 -- 172.21.15.40:0/4220914284 wait complete. 2024-09-21T01:49:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.603+0000 7fd8190d5640 1 Processor -- start 2024-09-21T01:49:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.603+0000 7fd8190d5640 1 -- start start 2024-09-21T01:49:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd8190d5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd814074640 0x7fd814163d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd8190d5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd8140cc630 0x7fd814165310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.613+0000 7f7fddad5640 1 -- 172.21.15.40:0/883888508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd8073370 msgr2=0x7f7fd80cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.613+0000 7f7fddad5640 1 --2- 172.21.15.40:0/883888508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd8073370 0x7f7fd80cf790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7fd806dca0 tx=0x7f7fcc02a580 comp rx=0 tx=0).stop 2024-09-21T01:49:15.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7f7fddad5640 1 -- 172.21.15.40:0/883888508 shutdown_connections 2024-09-21T01:49:15.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7f7fddad5640 1 --2- 172.21.15.40:0/883888508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd8073370 0x7f7fd80cf790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7f7fddad5640 1 --2- 172.21.15.40:0/883888508 >> v2:172.21.15.139:3300/0 conn(0x7f7fd8162f20 0x7f7fd8072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7f7fddad5640 1 -- 172.21.15.40:0/883888508 >> 172.21.15.40:0/883888508 conn(0x7f7fd806d410 msgr2=0x7f7fd80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7f7fddad5640 1 -- 172.21.15.40:0/883888508 shutdown_connections 2024-09-21T01:49:15.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7f7fddad5640 1 -- 172.21.15.40:0/883888508 wait complete. 2024-09-21T01:49:15.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.609+0000 7fa1d3307640 1 -- 172.21.15.40:0/623403746 shutdown_connections 2024-09-21T01:49:15.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.609+0000 7fa1d3307640 1 -- 172.21.15.40:0/623403746 wait complete. 2024-09-21T01:49:15.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fa1d3307640 1 Processor -- start 2024-09-21T01:49:15.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fa1d3307640 1 -- start start 2024-09-21T01:49:15.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7fa1d3307640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c4055110 0x7fa1c40f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7fa1d3307640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1c4047e70 0x7fa1c404da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7fa1d3307640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1c404df80 0x7fa1c404e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7fa1d3307640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4054130 con 0x7fa1c404df80 2024-09-21T01:49:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7fa1d3307640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4053fb0 con 0x7fa1c4055110 2024-09-21T01:49:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.614+0000 7fa1d3307640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c40542b0 con 0x7fa1c4047e70 2024-09-21T01:49:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.615+0000 7fa1d18a4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1c404df80 0x7fa1c404e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.615+0000 7fa1d18a4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1c404df80 0x7fa1c404e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38574/0 (socket says 172.21.15.40:38574) 2024-09-21T01:49:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.615+0000 7fa1d18a4640 1 -- 172.21.15.40:0/1665257919 learned_addr learned my addr 172.21.15.40:0/1665257919 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.615+0000 7fa1d10a3640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c4055110 0x7fa1c40f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.615+0000 7fa1d08a2640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1c4047e70 0x7fa1c404da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.606+0000 7fca61d71640 1 -- start start 2024-09-21T01:49:15.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.615+0000 7fca61d71640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca54006320 0x7fca54032480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd8190d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140c5db0 0x7fd814166d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd8190d5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd8140ccf80 con 0x7fd8140c5db0 2024-09-21T01:49:15.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd8190d5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd81408be20 con 0x7fd814074640 2024-09-21T01:49:15.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd8190d5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fd8140cd100 con 0x7fd8140cc630 2024-09-21T01:49:15.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd81359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140c5db0 0x7fd814166d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd81359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140c5db0 0x7fd814166d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38568/0 (socket says 172.21.15.40:38568) 2024-09-21T01:49:15.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd81359e640 1 -- 172.21.15.40:0/494352302 learned_addr learned my addr 172.21.15.40:0/494352302 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd81359e640 1 -- 172.21.15.40:0/494352302 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd8140cc630 msgr2=0x7fd814165310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:49:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.612+0000 7fd81359e640 1 --2- 172.21.15.40:0/494352302 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd8140cc630 0x7fd814165310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.613+0000 7fd81359e640 1 -- 172.21.15.40:0/494352302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd814074640 msgr2=0x7fd814163d70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:49:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.613+0000 7fd81359e640 1 --2- 172.21.15.40:0/494352302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd814074640 0x7fd814163d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.613+0000 7fd81359e640 1 -- 172.21.15.40:0/494352302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd814165cf0 con 0x7fd8140c5db0 2024-09-21T01:49:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fd81359e640 1 --2- 172.21.15.40:0/494352302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140c5db0 0x7fd814166d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd80800d6d0 tx=0x7fd80800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca5b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca54006320 0x7fca54032480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca5b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca54006320 0x7fca54032480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38576/0 (socket says 172.21.15.40:38576) 2024-09-21T01:49:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca5b7fe640 1 -- 172.21.15.40:0/2548866474 learned_addr learned my addr 172.21.15.40:0/2548866474 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca61d71640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca54052360 0x7fca54186460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fd7fb7fe640 1 -- 172.21.15.40:0/494352302 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808017070 con 0x7fd8140c5db0 2024-09-21T01:49:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca61d71640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca540dd520 0x7fca540489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca5affd640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca54052360 0x7fca54186460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca61d71640 1 -- 172.21.15.40:0/2548866474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fca54006730 con 0x7fca54006320 2024-09-21T01:49:15.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca61d71640 1 -- 172.21.15.40:0/2548866474 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fca540e3620 con 0x7fca540dd520 2024-09-21T01:49:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca5bfff640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca540dd520 0x7fca540489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fca61d71640 1 -- 172.21.15.40:0/2548866474 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fca540068b0 con 0x7fca54052360 2024-09-21T01:49:15.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.613+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95880d0250 msgr2=0x7f95880cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.613+0000 7f958759e640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95880d0250 0x7f95880cd350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f958000bdf0 tx=0x7f9580009ef0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.617+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 shutdown_connections 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.617+0000 7f958759e640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f95880d0250 0x7f95880cd350 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.617+0000 7f958759e640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f95880b9540 0x7f95880a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.617+0000 7f958759e640 1 --2- 172.21.15.40:0/48356762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95880b3660 0x7f958815e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.617+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 >> 172.21.15.40:0/48356762 conn(0x7f958809d680 msgr2=0x7f95880d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.617+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 shutdown_connections 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.617+0000 7f958759e640 1 -- 172.21.15.40:0/48356762 wait complete. 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.618+0000 7fca5b7fe640 1 -- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca54052360 msgr2=0x7fca54186460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.618+0000 7fca5b7fe640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca54052360 0x7fca54186460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.618+0000 7fca5b7fe640 1 -- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca540dd520 msgr2=0x7fca540489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.618+0000 7fca5b7fe640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca540dd520 0x7fca540489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.618+0000 7fca5b7fe640 1 -- 172.21.15.40:0/2548866474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca54031ca0 con 0x7fca54006320 2024-09-21T01:49:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fd8190d5640 1 -- 172.21.15.40:0/494352302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd814165fd0 con 0x7fd8140c5db0 2024-09-21T01:49:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fd8190d5640 1 -- 172.21.15.40:0/494352302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd814166590 con 0x7fd8140c5db0 2024-09-21T01:49:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.618+0000 7fd7fb7fe640 1 -- 172.21.15.40:0/494352302 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd808004330 con 0x7fd8140c5db0 2024-09-21T01:49:15.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.618+0000 7fd7fb7fe640 1 -- 172.21.15.40:0/494352302 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808009a80 con 0x7fd8140c5db0 2024-09-21T01:49:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.618+0000 7fca5b7fe640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca54006320 0x7fca54032480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fca4800b3c0 tx=0x7fca4800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.619+0000 7fca47fff640 1 -- 172.21.15.40:0/2548866474 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48005920 con 0x7fca54006320 2024-09-21T01:49:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.619+0000 7fca47fff640 1 -- 172.21.15.40:0/2548866474 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca48005bd0 con 0x7fca54006320 2024-09-21T01:49:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.619+0000 7fca61d71640 1 -- 172.21.15.40:0/2548866474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca540dc710 con 0x7fca54006320 2024-09-21T01:49:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.619+0000 7fca61d71640 1 -- 172.21.15.40:0/2548866474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca54031f60 con 0x7fca54006320 2024-09-21T01:49:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.619+0000 7fd7fb7fe640 1 -- 172.21.15.40:0/494352302 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd808009c20 con 0x7fd8140c5db0 2024-09-21T01:49:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.619+0000 7fd7fb7fe640 1 -- 172.21.15.40:0/494352302 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd808010750 con 0x7fd8140c5db0 2024-09-21T01:49:15.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.619+0000 7fd7f97fa640 1 -- 172.21.15.40:0/494352302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f4005290 con 0x7fd8140c5db0 2024-09-21T01:49:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.621+0000 7fca47fff640 1 -- 172.21.15.40:0/2548866474 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48006020 con 0x7fca54006320 2024-09-21T01:49:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.621+0000 7fca47fff640 1 -- 172.21.15.40:0/2548866474 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca48018020 con 0x7fca54006320 2024-09-21T01:49:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.623+0000 7fca45ffb640 1 -- 172.21.15.40:0/2548866474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3c005290 con 0x7fca54006320 2024-09-21T01:49:15.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fa1d10a3640 1 -- 172.21.15.40:0/1665257919 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1c4047e70 msgr2=0x7fa1c404da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fa1d10a3640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1c4047e70 0x7fa1c404da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.616+0000 7fa1d10a3640 1 -- 172.21.15.40:0/1665257919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1c404df80 msgr2=0x7fa1c404e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.622+0000 7fa1d10a3640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1c404df80 0x7fa1c404e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.627+0000 7fca47fff640 1 -- 172.21.15.40:0/2548866474 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fca48011630 con 0x7fca54006320 2024-09-21T01:49:15.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.628+0000 7fca47fff640 1 -- 172.21.15.40:0/2548866474 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fca48011830 con 0x7fca54006320 2024-09-21T01:49:15.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.622+0000 7fa1d10a3640 1 -- 172.21.15.40:0/1665257919 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c40f3530 con 0x7fa1c4055110 2024-09-21T01:49:15.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.622+0000 7fa1d10a3640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c4055110 0x7fa1c40f2ff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c390 tx=0x7fa1c800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.622+0000 7fa1c1ffb640 1 -- 172.21.15.40:0/1665257919 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8017070 con 0x7fa1c4055110 2024-09-21T01:49:15.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.629+0000 7f3e894a9640 1 -- 172.21.15.40:0/1572176635 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3e840b4f70 msgr2=0x7f3e840b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.629+0000 7f3e894a9640 1 --2- 172.21.15.40:0/1572176635 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3e840b4f70 0x7f3e840b5380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009be0 tx=0x7f3e7c02a8d0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.622+0000 7fa1d3307640 1 -- 172.21.15.40:0/1665257919 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c40fa3d0 con 0x7fa1c4055110 2024-09-21T01:49:15.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.622+0000 7fa1d3307640 1 -- 172.21.15.40:0/1665257919 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c40fa990 con 0x7fa1c4055110 2024-09-21T01:49:15.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.630+0000 7fd7fb7fe640 1 -- 172.21.15.40:0/494352302 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd8080109a0 con 0x7fd8140c5db0 2024-09-21T01:49:15.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.623+0000 7fa1d18a4640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1c404df80 0x7fa1c404e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:15.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.624+0000 7fa1c1ffb640 1 -- 172.21.15.40:0/1665257919 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1c80052d0 con 0x7fa1c4055110 2024-09-21T01:49:15.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.624+0000 7fa1c1ffb640 1 -- 172.21.15.40:0/1665257919 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8003850 con 0x7fa1c4055110 2024-09-21T01:49:15.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.629+0000 7fa1c1ffb640 1 -- 172.21.15.40:0/1665257919 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa1c801a070 con 0x7fa1c4055110 2024-09-21T01:49:15.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.629+0000 7fa1c1ffb640 1 -- 172.21.15.40:0/1665257919 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa1c801c440 con 0x7fa1c4055110 2024-09-21T01:49:15.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.629+0000 7fa1b77fe640 1 -- 172.21.15.40:0/1665257919 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ac005290 con 0x7fa1c4055110 2024-09-21T01:49:15.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.631+0000 7f7fddad5640 1 Processor -- start 2024-09-21T01:49:15.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.632+0000 7fa1c1ffb640 1 -- 172.21.15.40:0/1665257919 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa1c8021070 con 0x7fa1c4055110 2024-09-21T01:49:15.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.640+0000 7f7fddad5640 1 -- start start 2024-09-21T01:49:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.644+0000 7f7fddad5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd8073370 0x7f7fd8154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.644+0000 7f7fddad5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7fd80cfcd0 0x7f7fd809c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.644+0000 7f7fddad5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fd81569b0 0x7f7fd809c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.644+0000 7f7fddad5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd815fda0 con 0x7f7fd8073370 2024-09-21T01:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.646+0000 7f3e894a9640 1 -- 172.21.15.40:0/1572176635 shutdown_connections 2024-09-21T01:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.646+0000 7f3e894a9640 1 --2- 172.21.15.40:0/1572176635 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3e840b4f70 0x7f3e840b5380 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.646+0000 7f3e894a9640 1 -- 172.21.15.40:0/1572176635 >> 172.21.15.40:0/1572176635 conn(0x7f3e840b3c10 msgr2=0x7f3e840b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.646+0000 7f7fddad5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd815fc20 con 0x7f7fd81569b0 2024-09-21T01:49:15.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.646+0000 7f7fddad5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd815ff20 con 0x7f7fd80cfcd0 2024-09-21T01:49:15.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.647+0000 7f7fd77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd8073370 0x7f7fd8154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.647+0000 7f7fd77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd8073370 0x7f7fd8154fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38586/0 (socket says 172.21.15.40:38586) 2024-09-21T01:49:15.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.647+0000 7f7fd77fe640 1 -- 172.21.15.40:0/2873752475 learned_addr learned my addr 172.21.15.40:0/2873752475 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.648+0000 7f7fd6ffd640 1 --2- 172.21.15.40:0/2873752475 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7fd80cfcd0 0x7f7fd809c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.648+0000 7f7fd7fff640 1 --2- 172.21.15.40:0/2873752475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fd81569b0 0x7f7fd809c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.652+0000 7f7fd7fff640 1 -- 172.21.15.40:0/2873752475 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7fd80cfcd0 msgr2=0x7f7fd809c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.652+0000 7f7fd7fff640 1 --2- 172.21.15.40:0/2873752475 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7fd80cfcd0 0x7f7fd809c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.652+0000 7f7fd7fff640 1 -- 172.21.15.40:0/2873752475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd8073370 msgr2=0x7f7fd8154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.652+0000 7f7fd7fff640 1 --2- 172.21.15.40:0/2873752475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd8073370 0x7f7fd8154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.652+0000 7f3e894a9640 1 -- 172.21.15.40:0/1572176635 shutdown_connections 2024-09-21T01:49:15.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.652+0000 7f7fd7fff640 1 -- 172.21.15.40:0/2873752475 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd81554e0 con 0x7f7fd81569b0 2024-09-21T01:49:15.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.658+0000 7f7fd7fff640 1 --2- 172.21.15.40:0/2873752475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fd81569b0 0x7f7fd809c970 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7fd815f200 tx=0x7f7fd000cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.660 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7feffa88b640 1 -- 172.21.15.40:0/3779559483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefdc0099b0 msgr2=0x7fefdc00bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7feffa88b640 1 --2- 172.21.15.40:0/3779559483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefdc0099b0 0x7fefdc00bdd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fefec0097b0 tx=0x7fefdc005830 comp rx=0 tx=0).stop 2024-09-21T01:49:15.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7feffa88b640 1 -- 172.21.15.40:0/3779559483 shutdown_connections 2024-09-21T01:49:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7feffa88b640 1 --2- 172.21.15.40:0/3779559483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefdc0099b0 0x7fefdc00bdd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7feffa88b640 1 -- 172.21.15.40:0/3779559483 >> 172.21.15.40:0/3779559483 conn(0x7feff40cdc60 msgr2=0x7feff40ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.661+0000 7f7fbffff640 1 -- 172.21.15.40:0/2873752475 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0016020 con 0x7f7fd81569b0 2024-09-21T01:49:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.661+0000 7f7fddad5640 1 -- 172.21.15.40:0/2873752475 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd81592c0 con 0x7f7fd81569b0 2024-09-21T01:49:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.661+0000 7f7fddad5640 1 -- 172.21.15.40:0/2873752475 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd8159560 con 0x7f7fd81569b0 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.654+0000 7f3e894a9640 1 -- 172.21.15.40:0/1572176635 wait complete. 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.657+0000 7f3e894a9640 1 Processor -- start 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.657+0000 7f3e894a9640 1 -- start start 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.660+0000 7f3e894a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e8406f110 0x7f3e842099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.660+0000 7f3e894a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e840b4f70 0x7f3e84166580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.660+0000 7f3e894a9640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3e840d1830 0x7f3e841688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.660+0000 7f3e894a9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e84169fa0 con 0x7f3e840b4f70 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.660+0000 7f3e894a9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e84169e20 con 0x7f3e8406f110 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.660+0000 7f3e894a9640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8416a120 con 0x7f3e840d1830 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.661+0000 7f3e837fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3e840d1830 0x7f3e841688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.661+0000 7f3e837fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3e840d1830 0x7f3e841688e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:43274/0 (socket says 172.21.15.40:43274) 2024-09-21T01:49:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.661+0000 7f3e837fe640 1 -- 172.21.15.40:0/554488108 learned_addr learned my addr 172.21.15.40:0/554488108 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7f3e827fc640 1 --2- 172.21.15.40:0/554488108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e840b4f70 0x7f3e84166580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7f3e827fc640 1 -- 172.21.15.40:0/554488108 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3e840d1830 msgr2=0x7f3e841688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7f3e827fc640 1 --2- 172.21.15.40:0/554488108 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3e840d1830 0x7f3e841688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7f3e827fc640 1 -- 172.21.15.40:0/554488108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e8406f110 msgr2=0x7f3e842099d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:49:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7f3e827fc640 1 --2- 172.21.15.40:0/554488108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e8406f110 0x7f3e842099d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.662+0000 7f3e827fc640 1 -- 172.21.15.40:0/554488108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8420a220 con 0x7f3e840b4f70 2024-09-21T01:49:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.663+0000 7f3e827fc640 1 --2- 172.21.15.40:0/554488108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e840b4f70 0x7f3e84166580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e78001eb0 tx=0x7f3e7800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.663+0000 7f3e6b7fe640 1 -- 172.21.15.40:0/554488108 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78017070 con 0x7f3e840b4f70 2024-09-21T01:49:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.663+0000 7f3e6b7fe640 1 -- 172.21.15.40:0/554488108 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e780053e0 con 0x7f3e840b4f70 2024-09-21T01:49:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.663+0000 7f3e6b7fe640 1 -- 172.21.15.40:0/554488108 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e780118b0 con 0x7f3e840b4f70 2024-09-21T01:49:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.663+0000 7f3e894a9640 1 -- 172.21.15.40:0/554488108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8420a500 con 0x7f3e840b4f70 2024-09-21T01:49:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.664+0000 7f3e894a9640 1 -- 172.21.15.40:0/554488108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e842066f0 con 0x7f3e840b4f70 2024-09-21T01:49:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.663+0000 7f7fbffff640 1 -- 172.21.15.40:0/2873752475 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fd000ac00 con 0x7f7fd81569b0 2024-09-21T01:49:15.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.661+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f00d0005850 con 0x7f00f0074db0 2024-09-21T01:49:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.664+0000 7feffa88b640 1 -- 172.21.15.40:0/3779559483 shutdown_connections 2024-09-21T01:49:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.664+0000 7feffa88b640 1 -- 172.21.15.40:0/3779559483 wait complete. 2024-09-21T01:49:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.668+0000 7feffa88b640 1 Processor -- start 2024-09-21T01:49:15.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.668+0000 7feffa88b640 1 -- start start 2024-09-21T01:49:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.667+0000 7f3e6b7fe640 1 -- 172.21.15.40:0/554488108 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3e7801a070 con 0x7f3e840b4f70 2024-09-21T01:49:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.667+0000 7f3e6b7fe640 1 -- 172.21.15.40:0/554488108 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3e7801c780 con 0x7f3e840b4f70 2024-09-21T01:49:15.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.670+0000 7f3e894a9640 1 -- 172.21.15.40:0/554488108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e840b5380 con 0x7f3e840b4f70 2024-09-21T01:49:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.671+0000 7feffa88b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefdc0099b0 0x7feff4148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.668+0000 7f8fbbfff640 1 -- 172.21.15.40:0/1936872052 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb400b6e0 con 0x7f8fb0004800 2024-09-21T01:49:15.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.671+0000 7f7fbffff640 1 -- 172.21.15.40:0/2873752475 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0016020 con 0x7f7fd81569b0 2024-09-21T01:49:15.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.671+0000 7f7fbffff640 1 -- 172.21.15.40:0/2873752475 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7fd0019020 con 0x7f7fd81569b0 2024-09-21T01:49:15.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.671+0000 7f7fbffff640 1 -- 172.21.15.40:0/2873752475 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7fd000a910 con 0x7f7fd81569b0 2024-09-21T01:49:15.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7f8fca0b1640 1 -- 172.21.15.40:0/1936872052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb0004800 msgr2=0x7f8fb0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7f8fca0b1640 1 --2- 172.21.15.40:0/1936872052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb0004800 0x7f8fb0004c10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400bb00 tx=0x7f8fb0005830 comp rx=0 tx=0).stop 2024-09-21T01:49:15.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7f7fbdffb640 1 -- 172.21.15.40:0/2873752475 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb8005290 con 0x7f7fd81569b0 2024-09-21T01:49:15.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7f8fca0b1640 1 -- 172.21.15.40:0/1936872052 shutdown_connections 2024-09-21T01:49:15.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7feffa88b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feff4148ad0 0x7feff413e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7f8fca0b1640 1 --2- 172.21.15.40:0/1936872052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb0004800 0x7f8fb0004c10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7f8fca0b1640 1 -- 172.21.15.40:0/1936872052 >> 172.21.15.40:0/1936872052 conn(0x7f8fc40b3c50 msgr2=0x7f8fc40b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7feff3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefdc0099b0 0x7feff4148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7feff3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefdc0099b0 0x7feff4148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.40:45312/0 (socket says 172.21.15.40:45312) 2024-09-21T01:49:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7feff3fff640 1 -- 172.21.15.40:0/1327726769 learned_addr learned my addr 172.21.15.40:0/1327726769 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7feffa88b640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff4151e10 0x7feff4152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7feff37fe640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feff4148ad0 0x7feff413e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.672+0000 7f8fca0b1640 1 -- 172.21.15.40:0/1936872052 shutdown_connections 2024-09-21T01:49:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.673+0000 7feff8e28640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff4151e10 0x7feff4152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.673+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7feff40cd330 con 0x7feff4151e10 2024-09-21T01:49:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.673+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feff40cd1b0 con 0x7fefdc0099b0 2024-09-21T01:49:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.673+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7feff40cd4b0 con 0x7feff4148ad0 2024-09-21T01:49:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.674+0000 7feff37fe640 1 -- 172.21.15.40:0/1327726769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefdc0099b0 msgr2=0x7feff4148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.674+0000 7feff37fe640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefdc0099b0 0x7feff4148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.674+0000 7feff37fe640 1 -- 172.21.15.40:0/1327726769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff4151e10 msgr2=0x7feff4152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.674+0000 7feff37fe640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff4151e10 0x7feff4152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.674+0000 7feff37fe640 1 -- 172.21.15.40:0/1327726769 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff4152760 con 0x7feff4148ad0 2024-09-21T01:49:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.674+0000 7feff37fe640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feff4148ad0 0x7feff413e920 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feff4073e20 tx=0x7fefe400ca80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.675+0000 7f4e6138e640 1 -- 172.21.15.40:0/3567639869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e5c072e30 msgr2=0x7f4e5c073240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.675+0000 7f4e6138e640 1 --2- 172.21.15.40:0/3567639869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e5c072e30 0x7f4e5c073240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0b2d50 tx=0x7f4e4c02a610 comp rx=0 tx=0).stop 2024-09-21T01:49:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.675+0000 7feff0ff9640 1 -- 172.21.15.40:0/1327726769 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe400e880 con 0x7feff4148ad0 2024-09-21T01:49:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.675+0000 7feff0ff9640 1 -- 172.21.15.40:0/1327726769 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefe400eb10 con 0x7feff4148ad0 2024-09-21T01:49:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.675+0000 7feff0ff9640 1 -- 172.21.15.40:0/1327726769 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe400f450 con 0x7feff4148ad0 2024-09-21T01:49:15.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.675+0000 7f4e6138e640 1 -- 172.21.15.40:0/3567639869 shutdown_connections 2024-09-21T01:49:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.675+0000 7f4e6138e640 1 --2- 172.21.15.40:0/3567639869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e5c072e30 0x7f4e5c073240 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f4e6138e640 1 --2- 172.21.15.40:0/3567639869 >> v2:172.21.15.40:3300/0 conn(0x7f4e5c15f650 0x7f4e5c15fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.673+0000 7f8fca0b1640 1 -- 172.21.15.40:0/1936872052 wait complete. 2024-09-21T01:49:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f8fca0b1640 1 Processor -- start 2024-09-21T01:49:15.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f4e6138e640 1 -- 172.21.15.40:0/3567639869 >> 172.21.15.40:0/3567639869 conn(0x7f4e5c06d410 msgr2=0x7f4e5c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f8fca0b1640 1 -- start start 2024-09-21T01:49:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f6264513640 1 -- 172.21.15.40:0/235331245 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f6244005580 con 0x7f625c0b0010 2024-09-21T01:49:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f076076e640 1 -- 172.21.15.40:0/4187761190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2310 msgr2=0x7f07580b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f076076e640 1 --2- 172.21.15.40:0/4187761190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2310 0x7f07580b3690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f07540098e0 tx=0x7f075402a580 comp rx=0 tx=0).stop 2024-09-21T01:49:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f076076e640 1 -- 172.21.15.40:0/4187761190 shutdown_connections 2024-09-21T01:49:15.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f076076e640 1 --2- 172.21.15.40:0/4187761190 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07580d2860 0x7f07580b8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f076076e640 1 --2- 172.21.15.40:0/4187761190 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2310 0x7f07580b3690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7f076076e640 1 -- 172.21.15.40:0/4187761190 >> 172.21.15.40:0/4187761190 conn(0x7f07580d1590 msgr2=0x7f07580d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.676+0000 7feff8e28640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff4151e10 0x7feff4152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.677+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff414d5f0 con 0x7feff4148ad0 2024-09-21T01:49:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.677+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feff41f4e20 con 0x7feff4148ad0 2024-09-21T01:49:15.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.677+0000 7feff0ff9640 1 -- 172.21.15.40:0/1327726769 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fefe400f5f0 con 0x7feff4148ad0 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.678+0000 7f8fca0b1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb0004800 0x7f8fc41f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.678+0000 7f8fc90af640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb0004800 0x7f8fc41f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.678+0000 7f8fc90af640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb0004800 0x7f8fc41f4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38644/0 (socket says 172.21.15.40:38644) 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.678+0000 7f8fca0b1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fc40c66a0 0x7f8fc4072360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.678+0000 7f8fc90af640 1 -- 172.21.15.40:0/642838277 learned_addr learned my addr 172.21.15.40:0/642838277 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.679+0000 7f8fca0b1640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fc40cb440 0x7f8fc40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.679+0000 7f8fc88ae640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fc40c66a0 0x7f8fc4072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.679+0000 7f8fc98b0640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fc40cb440 0x7f8fc40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.679+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc409af80 con 0x7f8fb0004800 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.679+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc409ae00 con 0x7f8fc40cb440 2024-09-21T01:49:15.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.679+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc409b100 con 0x7f8fc40c66a0 2024-09-21T01:49:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f4e6138e640 1 -- 172.21.15.40:0/3567639869 shutdown_connections 2024-09-21T01:49:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f4e6138e640 1 -- 172.21.15.40:0/3567639869 wait complete. 2024-09-21T01:49:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f8fc90af640 1 -- 172.21.15.40:0/642838277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fc40c66a0 msgr2=0x7f8fc4072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f8fc90af640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fc40c66a0 0x7f8fc4072360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f8fc90af640 1 -- 172.21.15.40:0/642838277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fc40cb440 msgr2=0x7f8fc40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f8fc90af640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fc40cb440 0x7f8fc40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f8fc90af640 1 -- 172.21.15.40:0/642838277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc40c6e80 con 0x7f8fb0004800 2024-09-21T01:49:15.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f8fc90af640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb0004800 0x7f8fc41f4ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000f6c0 tx=0x7f8fc000fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.683+0000 7f4e6138e640 1 Processor -- start 2024-09-21T01:49:15.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.683+0000 7f4e6138e640 1 -- start start 2024-09-21T01:49:15.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.686+0000 7feff0ff9640 1 -- 172.21.15.40:0/1327726769 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fefe4018c40 con 0x7feff4148ad0 2024-09-21T01:49:15.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f076076e640 1 -- 172.21.15.40:0/4187761190 shutdown_connections 2024-09-21T01:49:15.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.680+0000 7f076076e640 1 -- 172.21.15.40:0/4187761190 wait complete. 2024-09-21T01:49:15.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.683+0000 7f076076e640 1 Processor -- start 2024-09-21T01:49:15.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.683+0000 7f076076e640 1 -- start start 2024-09-21T01:49:15.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.687+0000 7f7fbffff640 1 -- 172.21.15.40:0/2873752475 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7fd0020020 con 0x7f7fd81569b0 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.687+0000 7f076076e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07580d2860 0x7f07580c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.687+0000 7f076076e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2db0 0x7f07581674f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.687+0000 7f076076e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0758167a30 0x7f0758073140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.687+0000 7f075e50a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07580d2860 0x7f07580c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.687+0000 7f075e50a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07580d2860 0x7f07580c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38660/0 (socket says 172.21.15.40:38660) 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.688+0000 7f075dd09640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2db0 0x7f07581674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.688+0000 7f075dd09640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2db0 0x7f07581674f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.40:45334/0 (socket says 172.21.15.40:45334) 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.688+0000 7f075e50a640 1 -- 172.21.15.40:0/431565161 learned_addr learned my addr 172.21.15.40:0/431565161 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.688+0000 7f075ed0b640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0758167a30 0x7f0758073140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.689+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff40b0890 con 0x7feff4148ad0 2024-09-21T01:49:15.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.688+0000 7f076076e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f075809c450 con 0x7f07580d2860 2024-09-21T01:49:15.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.688+0000 7f076076e640 1 -- 172.21.15.40:0/431565161 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f075809c2d0 con 0x7f07580d2db0 2024-09-21T01:49:15.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.688+0000 7f076076e640 1 -- 172.21.15.40:0/431565161 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f075809c5d0 con 0x7f0758167a30 2024-09-21T01:49:15.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.689+0000 7f075e50a640 1 -- 172.21.15.40:0/431565161 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0758167a30 msgr2=0x7f0758073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.689+0000 7f075e50a640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0758167a30 0x7f0758073140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.689+0000 7f075e50a640 1 -- 172.21.15.40:0/431565161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2db0 msgr2=0x7f07581674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.689+0000 7f075e50a640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2db0 0x7f07581674f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.689+0000 7f075e50a640 1 -- 172.21.15.40:0/431565161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0758167e40 con 0x7f07580d2860 2024-09-21T01:49:15.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.690+0000 7f075dd09640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2db0 0x7f07581674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:15.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.690+0000 7f075ed0b640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0758167a30 0x7f0758073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:15.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.690+0000 7f075e50a640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07580d2860 0x7f07580c8910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f07540097b0 tx=0x7f0754003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.692+0000 7f00d77fe640 1 -- 172.21.15.40:0/2289730921 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f00e4010cc0 con 0x7f00f0074db0 2024-09-21T01:49:15.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.689+0000 7f8fb9ffb640 1 -- 172.21.15.40:0/642838277 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0015070 con 0x7f8fb0004800 2024-09-21T01:49:15.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.689+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc40c7160 con 0x7f8fb0004800 2024-09-21T01:49:15.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.690+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc40c7720 con 0x7f8fb0004800 2024-09-21T01:49:15.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.691+0000 7f8fb9ffb640 1 -- 172.21.15.40:0/642838277 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fc0006170 con 0x7f8fb0004800 2024-09-21T01:49:15.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.691+0000 7f8fb9ffb640 1 -- 172.21.15.40:0/642838277 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0003830 con 0x7f8fb0004800 2024-09-21T01:49:15.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.689+0000 7f3e6b7fe640 1 -- 172.21.15.40:0/554488108 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3e78021020 con 0x7f3e840b4f70 2024-09-21T01:49:15.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.693+0000 7f4e6138e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e5c072e30 0x7f4e5c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.693+0000 7f4e6138e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e5c15ea80 0x7f4e5c14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0074db0 msgr2=0x7f00f0201f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f00f57ba640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0074db0 0x7f00f0201f20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f00e400d9f0 tx=0x7f00e400deb0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 shutdown_connections 2024-09-21T01:49:15.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f00f57ba640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f00f0162590 0x7f00f0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f00f57ba640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f00f00b11f0 0x7f00f00ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f00f57ba640 1 --2- 172.21.15.40:0/2289730921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00f0074db0 0x7f00f0201f20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 >> 172.21.15.40:0/2289730921 conn(0x7f00f0074220 msgr2=0x7f00f015e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 shutdown_connections 2024-09-21T01:49:15.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f00f57ba640 1 -- 172.21.15.40:0/2289730921 wait complete. 2024-09-21T01:49:15.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.693+0000 7feff0ff9640 1 -- 172.21.15.40:0/1327726769 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fefe4026020 con 0x7feff4148ad0 2024-09-21T01:49:15.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.694+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa4005290 con 0x7f8fb0004800 2024-09-21T01:49:15.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.704+0000 7f074effd640 1 -- 172.21.15.40:0/431565161 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0754041020 con 0x7f07580d2860 2024-09-21T01:49:15.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.704+0000 7f076076e640 1 -- 172.21.15.40:0/431565161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0758072c60 con 0x7f07580d2860 2024-09-21T01:49:15.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.704+0000 7f076076e640 1 -- 172.21.15.40:0/431565161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0758071ee0 con 0x7f07580d2860 2024-09-21T01:49:15.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.706+0000 7f074effd640 1 -- 172.21.15.40:0/431565161 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0754003c10 con 0x7f07580d2860 2024-09-21T01:49:15.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f074effd640 1 -- 172.21.15.40:0/431565161 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0754031c30 con 0x7f07580d2860 2024-09-21T01:49:15.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.708+0000 7f6252ffd640 1 -- 172.21.15.40:0/235331245 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f624c019d70 con 0x7f625c0b0010 2024-09-21T01:49:15.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f4e6138e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4e5c15f650 0x7f4e5c1f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:15.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f4e6138e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cf940 con 0x7f4e5c15ea80 2024-09-21T01:49:15.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f4e6138e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cf7c0 con 0x7f4e5c072e30 2024-09-21T01:49:15.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f4e6138e640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cfac0 con 0x7f4e5c15f650 2024-09-21T01:49:15.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f4e5a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e5c15ea80 0x7f4e5c14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f4e5a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e5c15ea80 0x7f4e5c14dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38666/0 (socket says 172.21.15.40:38666) 2024-09-21T01:49:15.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f4e5a7fc640 1 -- 172.21.15.40:0/2663794766 learned_addr learned my addr 172.21.15.40:0/2663794766 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:15.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f4e5b7fe640 1 --2- 172.21.15.40:0/2663794766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4e5c15f650 0x7f4e5c1f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.707+0000 7f4e5affd640 1 --2- 172.21.15.40:0/2663794766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e5c072e30 0x7f4e5c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:15.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.709+0000 7f074effd640 1 -- 172.21.15.40:0/431565161 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0754044020 con 0x7f07580d2860 2024-09-21T01:49:15.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.709+0000 7f074effd640 1 -- 172.21.15.40:0/431565161 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0754004de0 con 0x7f07580d2860 2024-09-21T01:49:15.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.709+0000 7f074cff9640 1 -- 172.21.15.40:0/431565161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0740005290 con 0x7f07580d2860 2024-09-21T01:49:15.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.709+0000 7f8fb9ffb640 1 -- 172.21.15.40:0/642838277 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8fc0018070 con 0x7f8fb0004800 2024-09-21T01:49:15.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.709+0000 7f8fb9ffb640 1 -- 172.21.15.40:0/642838277 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8fc00247c0 con 0x7f8fb0004800 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f6250ff9640 1 -- 172.21.15.40:0/235331245 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f625c0b0010 msgr2=0x7f625c158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f6250ff9640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f625c0b0010 0x7f625c158f30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f624c00b390 tx=0x7f624c00b850 comp rx=0 tx=0).stop 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f4e5a7fc640 1 -- 172.21.15.40:0/2663794766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4e5c15f650 msgr2=0x7f4e5c1f85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f4e5a7fc640 1 --2- 172.21.15.40:0/2663794766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4e5c15f650 0x7f4e5c1f85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f4e5a7fc640 1 -- 172.21.15.40:0/2663794766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e5c072e30 msgr2=0x7f4e5c150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f4e5a7fc640 1 --2- 172.21.15.40:0/2663794766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e5c072e30 0x7f4e5c150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f4e5a7fc640 1 -- 172.21.15.40:0/2663794766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5c151440 con 0x7f4e5c15ea80 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f6250ff9640 1 -- 172.21.15.40:0/235331245 shutdown_connections 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f6250ff9640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f625c15f5a0 0x7f625c0aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f6250ff9640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f625c0b0010 0x7f625c158f30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f6250ff9640 1 --2- 172.21.15.40:0/235331245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f625c06f660 0x7f625c0b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f6250ff9640 1 -- 172.21.15.40:0/235331245 >> 172.21.15.40:0/235331245 conn(0x7f625c0cd4b0 msgr2=0x7f625c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.710+0000 7f6250ff9640 1 -- 172.21.15.40:0/235331245 shutdown_connections 2024-09-21T01:49:15.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.714+0000 7f6250ff9640 1 -- 172.21.15.40:0/235331245 wait complete. 2024-09-21T01:49:15.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.714+0000 7f4e5a7fc640 1 --2- 172.21.15.40:0/2663794766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e5c15ea80 0x7f4e5c14dba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400ecb0 tx=0x7f4e5400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:15.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.716+0000 7f8fb9ffb640 1 -- 172.21.15.40:0/642838277 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8fc000cd50 con 0x7f8fb0004800 2024-09-21T01:49:15.731 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.734 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.736+0000 7f4e437fe640 1 -- 172.21.15.40:0/2663794766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e54003b70 con 0x7f4e5c15ea80 2024-09-21T01:49:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.736+0000 7f4e437fe640 1 -- 172.21.15.40:0/2663794766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e54003d10 con 0x7f4e5c15ea80 2024-09-21T01:49:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.736+0000 7f4e437fe640 1 -- 172.21.15.40:0/2663794766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e54004280 con 0x7f4e5c15ea80 2024-09-21T01:49:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.736+0000 7f4e6138e640 1 -- 172.21.15.40:0/2663794766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5c09ddd0 con 0x7f4e5c15ea80 2024-09-21T01:49:15.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.737+0000 7f4e6138e640 1 -- 172.21.15.40:0/2663794766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e5c09b110 con 0x7f4e5c15ea80 2024-09-21T01:49:15.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.737+0000 7f4e437fe640 1 -- 172.21.15.40:0/2663794766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e54021440 con 0x7f4e5c15ea80 2024-09-21T01:49:15.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.737+0000 7f4e437fe640 1 -- 172.21.15.40:0/2663794766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4e54018770 con 0x7f4e5c15ea80 2024-09-21T01:49:15.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.736+0000 7f074effd640 1 -- 172.21.15.40:0/431565161 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f075404b030 con 0x7f07580d2860 2024-09-21T01:49:15.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.738+0000 7f4e6138e640 1 -- 172.21.15.40:0/2663794766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5c073240 con 0x7f4e5c15ea80 2024-09-21T01:49:15.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.743+0000 7f4e437fe640 1 -- 172.21.15.40:0/2663794766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4e54038860 con 0x7f4e5c15ea80 2024-09-21T01:49:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.778+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f7304005580 con 0x7f731c006320 2024-09-21T01:49:15.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.785+0000 7f7320ff9640 1 -- 172.21.15.40:0/107360376 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f731001f030 con 0x7f731c006320 2024-09-21T01:49:15.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.787+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f731c006320 msgr2=0x7f731c187ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.787+0000 7f73291ce640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f731c006320 0x7f731c187ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f731000b410 tx=0x7f731000b8d0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.787+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 shutdown_connections 2024-09-21T01:49:15.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.787+0000 7f73291ce640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f731c0e71d0 0x7f731c0e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.787+0000 7f73291ce640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f731c052360 0x7f731c0e0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.787+0000 7f73291ce640 1 --2- 172.21.15.40:0/107360376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f731c006320 0x7f731c187ae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.787+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 >> 172.21.15.40:0/107360376 conn(0x7f731c01d9a0 msgr2=0x7f731c0e2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.790+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 shutdown_connections 2024-09-21T01:49:15.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.790+0000 7f73291ce640 1 -- 172.21.15.40:0/107360376 wait complete. 2024-09-21T01:49:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.796+0000 7f3957fff640 1 -- 172.21.15.40:0/636510151 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f394c005580 con 0x7f396c0d0a00 2024-09-21T01:49:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.797+0000 7fca45ffb640 1 -- 172.21.15.40:0/2548866474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fca3c005580 con 0x7fca54006320 2024-09-21T01:49:15.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.808+0000 7fca47fff640 1 -- 172.21.15.40:0/2548866474 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 120+0+0 (secure 0 0 0) 0x7fca48011a10 con 0x7fca54006320 2024-09-21T01:49:15.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.813+0000 7f395e7fc640 1 -- 172.21.15.40:0/636510151 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7f3960012420 con 0x7f396c0d0a00 2024-09-21T01:49:15.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.815+0000 7f3957fff640 1 -- 172.21.15.40:0/636510151 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396c0d0a00 msgr2=0x7f396c161250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.815+0000 7f3957fff640 1 --2- 172.21.15.40:0/636510151 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396c0d0a00 0x7f396c161250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f396000c430 tx=0x7f396000c8f0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.819+0000 7fca45ffb640 1 -- 172.21.15.40:0/2548866474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca54006320 msgr2=0x7fca54032480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.819+0000 7fca45ffb640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca54006320 0x7fca54032480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fca4800b3c0 tx=0x7fca4800b880 comp rx=0 tx=0).stop 2024-09-21T01:49:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7fca45ffb640 1 -- 172.21.15.40:0/2548866474 shutdown_connections 2024-09-21T01:49:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7fca45ffb640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca540dd520 0x7fca540489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7fca45ffb640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca54052360 0x7fca54186460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7fca45ffb640 1 --2- 172.21.15.40:0/2548866474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca54006320 0x7fca54032480 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fca4800b3c0 tx=0x7fca4800b880 comp rx=0 tx=0).stop 2024-09-21T01:49:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7f3957fff640 1 -- 172.21.15.40:0/636510151 shutdown_connections 2024-09-21T01:49:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7f3957fff640 1 --2- 172.21.15.40:0/636510151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f396c0d2900 0x7f396c161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7f3957fff640 1 --2- 172.21.15.40:0/636510151 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f396c0d0a00 0x7f396c161250 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7f3957fff640 1 --2- 172.21.15.40:0/636510151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0cf880 0x7f396c13fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7f3957fff640 1 -- 172.21.15.40:0/636510151 >> 172.21.15.40:0/636510151 conn(0x7f396c072aa0 msgr2=0x7f396c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7fca45ffb640 1 -- 172.21.15.40:0/2548866474 >> 172.21.15.40:0/2548866474 conn(0x7fca5401d9a0 msgr2=0x7fca540e12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7f3957fff640 1 -- 172.21.15.40:0/636510151 shutdown_connections 2024-09-21T01:49:15.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.820+0000 7f3957fff640 1 -- 172.21.15.40:0/636510151 wait complete. 2024-09-21T01:49:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.815+0000 7fa1b77fe640 1 -- 172.21.15.40:0/1665257919 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fa1ac005580 con 0x7fa1c4055110 2024-09-21T01:49:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.828+0000 7fca45ffb640 1 -- 172.21.15.40:0/2548866474 shutdown_connections 2024-09-21T01:49:15.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.835+0000 7fca45ffb640 1 -- 172.21.15.40:0/2548866474 wait complete. 2024-09-21T01:49:15.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.835+0000 7fa1c1ffb640 1 -- 172.21.15.40:0/1665257919 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7fa1c40f3530 con 0x7fa1c4055110 2024-09-21T01:49:15.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.836+0000 7fa1b77fe640 1 -- 172.21.15.40:0/1665257919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c4055110 msgr2=0x7fa1c40f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.836+0000 7fa1b77fe640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c4055110 0x7fa1c40f2ff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c390 tx=0x7fa1c800c850 comp rx=0 tx=0).stop 2024-09-21T01:49:15.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.837+0000 7fa1b77fe640 1 -- 172.21.15.40:0/1665257919 shutdown_connections 2024-09-21T01:49:15.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.837+0000 7fa1b77fe640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1c404df80 0x7fa1c404e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.837+0000 7fa1b77fe640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1c4047e70 0x7fa1c404da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.837+0000 7fa1b77fe640 1 --2- 172.21.15.40:0/1665257919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1c4055110 0x7fa1c40f2ff0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c390 tx=0x7fa1c800c850 comp rx=0 tx=0).stop 2024-09-21T01:49:15.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.837+0000 7fa1b77fe640 1 -- 172.21.15.40:0/1665257919 >> 172.21.15.40:0/1665257919 conn(0x7fa1c401d9d0 msgr2=0x7fa1c40fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.838+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f49b4005580 con 0x7f49d420a1d0 2024-09-21T01:49:15.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.843+0000 7fa1b77fe640 1 -- 172.21.15.40:0/1665257919 shutdown_connections 2024-09-21T01:49:15.847 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.847+0000 7fa1b77fe640 1 -- 172.21.15.40:0/1665257919 wait complete. 2024-09-21T01:49:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.852+0000 7fd7f97fa640 1 -- 172.21.15.40:0/494352302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fd7f4005580 con 0x7fd8140c5db0 2024-09-21T01:49:15.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.852+0000 7f49bb7fe640 1 -- 172.21.15.40:0/2603076495 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7f49c8019b20 con 0x7f49d420a1d0 2024-09-21T01:49:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.856+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49d420a1d0 msgr2=0x7f49d416e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.856+0000 7f49d964d640 1 --2- 172.21.15.40:0/2603076495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49d420a1d0 0x7f49d416e9a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49c800b3e0 tx=0x7f49c800b8a0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.857+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 shutdown_connections 2024-09-21T01:49:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.857+0000 7f49d964d640 1 --2- 172.21.15.40:0/2603076495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49d420a1d0 0x7f49d416e9a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.857+0000 7f49d964d640 1 --2- 172.21.15.40:0/2603076495 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49d4209dc0 0x7f49d416e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.857+0000 7f49d964d640 1 --2- 172.21.15.40:0/2603076495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49d408b140 0x7f49d40b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.857+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 >> 172.21.15.40:0/2603076495 conn(0x7f49d40b20a0 msgr2=0x7f49d40afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.857+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 shutdown_connections 2024-09-21T01:49:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.857+0000 7f49d964d640 1 -- 172.21.15.40:0/2603076495 wait complete. 2024-09-21T01:49:15.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.861+0000 7fd7fb7fe640 1 -- 172.21.15.40:0/494352302 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v17)=0 v17) ==== 125+0+0 (secure 0 0 0) 0x7fd808010c60 con 0x7fd8140c5db0 2024-09-21T01:49:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.867+0000 7fd7f97fa640 1 -- 172.21.15.40:0/494352302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140c5db0 msgr2=0x7fd814166d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.867+0000 7fd7f97fa640 1 --2- 172.21.15.40:0/494352302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140c5db0 0x7fd814166d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd80800d6d0 tx=0x7fd80800db90 comp rx=0 tx=0).stop 2024-09-21T01:49:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.867+0000 7fd7f97fa640 1 -- 172.21.15.40:0/494352302 shutdown_connections 2024-09-21T01:49:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.867+0000 7fd7f97fa640 1 --2- 172.21.15.40:0/494352302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8140c5db0 0x7fd814166d90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.867+0000 7fd7f97fa640 1 --2- 172.21.15.40:0/494352302 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd8140cc630 0x7fd814165310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.867+0000 7fd7f97fa640 1 --2- 172.21.15.40:0/494352302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd814074640 0x7fd814163d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.867+0000 7fd7f97fa640 1 -- 172.21.15.40:0/494352302 >> 172.21.15.40:0/494352302 conn(0x7fd81406d5d0 msgr2=0x7fd8140caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.867+0000 7fd7f97fa640 1 -- 172.21.15.40:0/494352302 shutdown_connections 2024-09-21T01:49:15.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.867+0000 7fd7f97fa640 1 -- 172.21.15.40:0/494352302 wait complete. 2024-09-21T01:49:15.876 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.876 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.901+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7feff40d09f0 con 0x7feff4148ad0 2024-09-21T01:49:15.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.905+0000 7f4e6138e640 1 -- 172.21.15.40:0/2663794766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f4e5c06ddf0 con 0x7f4e5c15ea80 2024-09-21T01:49:15.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.905+0000 7feff0ff9640 1 -- 172.21.15.40:0/1327726769 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v18)=0 v18) ==== 119+0+0 (secure 0 0 0) 0x7feff4152760 con 0x7feff4148ad0 2024-09-21T01:49:15.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.906+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feff4148ad0 msgr2=0x7feff413e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.906+0000 7feffa88b640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feff4148ad0 0x7feff413e920 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feff4073e20 tx=0x7fefe400ca80 comp rx=0 tx=0).stop 2024-09-21T01:49:15.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.906+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 shutdown_connections 2024-09-21T01:49:15.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.906+0000 7feffa88b640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feff4151e10 0x7feff4152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.906+0000 7feffa88b640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7feff4148ad0 0x7feff413e920 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.906+0000 7feffa88b640 1 --2- 172.21.15.40:0/1327726769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fefdc0099b0 0x7feff4148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.906+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 >> 172.21.15.40:0/1327726769 conn(0x7feff40cdc60 msgr2=0x7feff4153980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.907+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 shutdown_connections 2024-09-21T01:49:15.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.907+0000 7feffa88b640 1 -- 172.21.15.40:0/1327726769 wait complete. 2024-09-21T01:49:15.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.909+0000 7f3e894a9640 1 -- 172.21.15.40:0/554488108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3e84209f40 con 0x7f3e840b4f70 2024-09-21T01:49:15.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.911+0000 7f4e437fe640 1 -- 172.21.15.40:0/2663794766 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f4e54026070 con 0x7f4e5c15ea80 2024-09-21T01:49:15.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.913+0000 7f4e6138e640 1 -- 172.21.15.40:0/2663794766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e5c15ea80 msgr2=0x7f4e5c14dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.913+0000 7f4e6138e640 1 --2- 172.21.15.40:0/2663794766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e5c15ea80 0x7f4e5c14dba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e5400ecb0 tx=0x7f4e5400c6a0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.913+0000 7f4e6138e640 1 -- 172.21.15.40:0/2663794766 shutdown_connections 2024-09-21T01:49:15.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.913+0000 7f4e6138e640 1 --2- 172.21.15.40:0/2663794766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4e5c15f650 0x7f4e5c1f85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.913+0000 7f4e6138e640 1 --2- 172.21.15.40:0/2663794766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e5c15ea80 0x7f4e5c14dba0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.913+0000 7f4e6138e640 1 --2- 172.21.15.40:0/2663794766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e5c072e30 0x7f4e5c150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.913+0000 7f4e6138e640 1 -- 172.21.15.40:0/2663794766 >> 172.21.15.40:0/2663794766 conn(0x7f4e5c06d410 msgr2=0x7f4e5c161710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.913+0000 7f4e6138e640 1 -- 172.21.15.40:0/2663794766 shutdown_connections 2024-09-21T01:49:15.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.913+0000 7f4e6138e640 1 -- 172.21.15.40:0/2663794766 wait complete. 2024-09-21T01:49:15.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.915+0000 7f3e6b7fe640 1 -- 172.21.15.40:0/554488108 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v20)=0 v20) ==== 106+0+0 (secure 0 0 0) 0x7f3e78011b40 con 0x7f3e840b4f70 2024-09-21T01:49:15.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.918+0000 7f3e894a9640 1 -- 172.21.15.40:0/554488108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e840b4f70 msgr2=0x7f3e84166580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.918+0000 7f3e894a9640 1 --2- 172.21.15.40:0/554488108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e840b4f70 0x7f3e84166580 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3e78001eb0 tx=0x7f3e7800c820 comp rx=0 tx=0).stop 2024-09-21T01:49:15.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.918+0000 7f3e894a9640 1 -- 172.21.15.40:0/554488108 shutdown_connections 2024-09-21T01:49:15.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.918+0000 7f3e894a9640 1 --2- 172.21.15.40:0/554488108 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3e840d1830 0x7f3e841688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.918+0000 7f3e894a9640 1 --2- 172.21.15.40:0/554488108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e840b4f70 0x7f3e84166580 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.918+0000 7f3e894a9640 1 --2- 172.21.15.40:0/554488108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e8406f110 0x7f3e842099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.918+0000 7f3e894a9640 1 -- 172.21.15.40:0/554488108 >> 172.21.15.40:0/554488108 conn(0x7f3e840b3c10 msgr2=0x7f3e84072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.920+0000 7f074cff9640 1 -- 172.21.15.40:0/431565161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f0740005580 con 0x7f07580d2860 2024-09-21T01:49:15.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.921+0000 7f3e894a9640 1 -- 172.21.15.40:0/554488108 shutdown_connections 2024-09-21T01:49:15.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.922+0000 7f3e894a9640 1 -- 172.21.15.40:0/554488108 wait complete. 2024-09-21T01:49:15.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.923+0000 7f7fbdffb640 1 -- 172.21.15.40:0/2873752475 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f7fb8005850 con 0x7f7fd81569b0 2024-09-21T01:49:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.927+0000 7f074effd640 1 -- 172.21.15.40:0/431565161 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f0758167e40 con 0x7f07580d2860 2024-09-21T01:49:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.928+0000 7f074cff9640 1 -- 172.21.15.40:0/431565161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07580d2860 msgr2=0x7f07580c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.928+0000 7f074cff9640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07580d2860 0x7f07580c8910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f07540097b0 tx=0x7f0754003820 comp rx=0 tx=0).stop 2024-09-21T01:49:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.928+0000 7f074cff9640 1 -- 172.21.15.40:0/431565161 shutdown_connections 2024-09-21T01:49:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.928+0000 7f074cff9640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0758167a30 0x7f0758073140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.928+0000 7f074cff9640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07580d2db0 0x7f07581674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.928+0000 7f074cff9640 1 --2- 172.21.15.40:0/431565161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07580d2860 0x7f07580c8910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.928+0000 7f074cff9640 1 -- 172.21.15.40:0/431565161 >> 172.21.15.40:0/431565161 conn(0x7f07580d1590 msgr2=0x7f07580b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.928+0000 7f074cff9640 1 -- 172.21.15.40:0/431565161 shutdown_connections 2024-09-21T01:49:15.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.928+0000 7f074cff9640 1 -- 172.21.15.40:0/431565161 wait complete. 2024-09-21T01:49:15.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.931 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.932+0000 7f7fbffff640 1 -- 172.21.15.40:0/2873752475 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v22)=0 v22) ==== 108+0+0 (secure 0 0 0) 0x7f7fd0020020 con 0x7f7fd81569b0 2024-09-21T01:49:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.933+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f8fa4005580 con 0x7f8fb0004800 2024-09-21T01:49:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.933+0000 7f7fbdffb640 1 -- 172.21.15.40:0/2873752475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fd81569b0 msgr2=0x7f7fd809c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.933+0000 7f7fbdffb640 1 --2- 172.21.15.40:0/2873752475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fd81569b0 0x7f7fd809c970 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7fd815f200 tx=0x7f7fd000cf00 comp rx=0 tx=0).stop 2024-09-21T01:49:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.933+0000 7f7fbdffb640 1 -- 172.21.15.40:0/2873752475 shutdown_connections 2024-09-21T01:49:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.933+0000 7f7fbdffb640 1 --2- 172.21.15.40:0/2873752475 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7fd81569b0 0x7f7fd809c970 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.933+0000 7f7fbdffb640 1 --2- 172.21.15.40:0/2873752475 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7fd80cfcd0 0x7f7fd809c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.933+0000 7f7fbdffb640 1 --2- 172.21.15.40:0/2873752475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd8073370 0x7f7fd8154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.933+0000 7f7fbdffb640 1 -- 172.21.15.40:0/2873752475 >> 172.21.15.40:0/2873752475 conn(0x7f7fd806d410 msgr2=0x7f7fd8160b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.934+0000 7f7fbdffb640 1 -- 172.21.15.40:0/2873752475 shutdown_connections 2024-09-21T01:49:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.934+0000 7f7fbdffb640 1 -- 172.21.15.40:0/2873752475 wait complete. 2024-09-21T01:49:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.937+0000 7f8fb9ffb640 1 -- 172.21.15.40:0/642838277 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v23)=0 v23) ==== 111+0+0 (secure 0 0 0) 0x7f8fc000c800 con 0x7f8fb0004800 2024-09-21T01:49:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.938+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb0004800 msgr2=0x7f8fc41f4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.938+0000 7f8fca0b1640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb0004800 0x7f8fc41f4ca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8fc000f6c0 tx=0x7f8fc000fb80 comp rx=0 tx=0).stop 2024-09-21T01:49:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.938+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 shutdown_connections 2024-09-21T01:49:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.938+0000 7f8fca0b1640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fc40cb440 0x7f8fc40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.938+0000 7f8fca0b1640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fc40c66a0 0x7f8fc4072360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.938+0000 7f8fca0b1640 1 --2- 172.21.15.40:0/642838277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb0004800 0x7f8fc41f4ca0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.938+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 >> 172.21.15.40:0/642838277 conn(0x7f8fc40b3c50 msgr2=0x7f8fc40ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.938+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 shutdown_connections 2024-09-21T01:49:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:15.938+0000 7f8fca0b1640 1 -- 172.21.15.40:0/642838277 wait complete. 2024-09-21T01:49:15.951 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.951 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.951 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.951 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.951 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi040') 2024-09-21T01:49:15.951 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config dump 2024-09-21T01:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.104+0000 7efdd0415640 1 -- 172.21.15.40:0/1733798211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc809aa30 msgr2=0x7efdc80cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.104+0000 7efdd0415640 1 --2- 172.21.15.40:0/1733798211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc809aa30 0x7efdc80cee10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efdc80d2320 tx=0x7efdbc02a5f0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.104+0000 7efdd0415640 1 -- 172.21.15.40:0/1733798211 shutdown_connections 2024-09-21T01:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.104+0000 7efdd0415640 1 --2- 172.21.15.40:0/1733798211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc809aa30 0x7efdc80cee10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.104+0000 7efdd0415640 1 --2- 172.21.15.40:0/1733798211 >> v2:172.21.15.139:3300/0 conn(0x7efdc815b900 0x7efdc80ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.104+0000 7efdd0415640 1 -- 172.21.15.40:0/1733798211 >> 172.21.15.40:0/1733798211 conn(0x7efdc8074170 msgr2=0x7efdc80b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.104+0000 7efdd0415640 1 -- 172.21.15.40:0/1733798211 shutdown_connections 2024-09-21T01:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.104+0000 7efdd0415640 1 -- 172.21.15.40:0/1733798211 wait complete. 2024-09-21T01:49:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.106+0000 7efdd0415640 1 Processor -- start 2024-09-21T01:49:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.106+0000 7efdd0415640 1 -- start start 2024-09-21T01:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdd0415640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc809aa30 0x7efdc81f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdd0415640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc80cdbf0 0x7efdc80cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdd0415640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdc815b900 0x7efdc809d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdd0415640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efdc80cf6e0 con 0x7efdc80cdbf0 2024-09-21T01:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdd0415640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efdc80cf560 con 0x7efdc809aa30 2024-09-21T01:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdd0415640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7efdc80cd1e0 con 0x7efdc815b900 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdcd9b0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc80cdbf0 0x7efdc80cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdcd9b0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc80cdbf0 0x7efdc80cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38684/0 (socket says 172.21.15.40:38684) 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdcd9b0640 1 -- 172.21.15.40:0/2336938695 learned_addr learned my addr 172.21.15.40:0/2336938695 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdce1b1640 1 --2- 172.21.15.40:0/2336938695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc809aa30 0x7efdc81f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.107+0000 7efdce9b2640 1 --2- 172.21.15.40:0/2336938695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdc815b900 0x7efdc809d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdcd9b0640 1 -- 172.21.15.40:0/2336938695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdc815b900 msgr2=0x7efdc809d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdcd9b0640 1 --2- 172.21.15.40:0/2336938695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdc815b900 0x7efdc809d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdcd9b0640 1 -- 172.21.15.40:0/2336938695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc809aa30 msgr2=0x7efdc81f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdcd9b0640 1 --2- 172.21.15.40:0/2336938695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc809aa30 0x7efdc81f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdcd9b0640 1 -- 172.21.15.40:0/2336938695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc809b8a0 con 0x7efdc80cdbf0 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdcd9b0640 1 --2- 172.21.15.40:0/2336938695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc80cdbf0 0x7efdc80cabb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efdbc034040 tx=0x7efdbc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdbaffd640 1 -- 172.21.15.40:0/2336938695 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc035040 con 0x7efdc80cdbf0 2024-09-21T01:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdbaffd640 1 -- 172.21.15.40:0/2336938695 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdbc003cb0 con 0x7efdc80cdbf0 2024-09-21T01:49:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdbaffd640 1 -- 172.21.15.40:0/2336938695 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc003ea0 con 0x7efdc80cdbf0 2024-09-21T01:49:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdd0415640 1 -- 172.21.15.40:0/2336938695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc809bb80 con 0x7efdc80cdbf0 2024-09-21T01:49:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdd0415640 1 -- 172.21.15.40:0/2336938695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc809c140 con 0x7efdc80cdbf0 2024-09-21T01:49:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdbaffd640 1 -- 172.21.15.40:0/2336938695 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efdbc004d90 con 0x7efdc80cdbf0 2024-09-21T01:49:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.108+0000 7efdbaffd640 1 -- 172.21.15.40:0/2336938695 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efdbc043430 con 0x7efdc80cdbf0 2024-09-21T01:49:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.109+0000 7efdd0415640 1 -- 172.21.15.40:0/2336938695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc80cd6d0 con 0x7efdc80cdbf0 2024-09-21T01:49:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.111+0000 7efdbaffd640 1 -- 172.21.15.40:0/2336938695 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efdbc052020 con 0x7efdc80cdbf0 2024-09-21T01:49:16.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.173+0000 7efdd0415640 1 -- 172.21.15.40:0/2336938695 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7efdc809b5c0 con 0x7efdc80cdbf0 2024-09-21T01:49:16.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.173+0000 7efdbaffd640 1 -- 172.21.15.40:0/2336938695 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7efdbc03a4f0 con 0x7efdc80cdbf0 2024-09-21T01:49:16.174 INFO:teuthology.orchestra.run.smithi040.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T01:49:16.174 INFO:teuthology.orchestra.run.smithi040.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T01:49:16.174 INFO:teuthology.orchestra.run.smithi040.stdout:mgr advanced client_mount_timeout 30 2024-09-21T01:49:16.174 INFO:teuthology.orchestra.run.smithi040.stdout:mgr advanced debug_client 20/20 2024-09-21T01:49:16.174 INFO:teuthology.orchestra.run.smithi040.stdout:mgr advanced debug_mgr 20/20 2024-09-21T01:49:16.174 INFO:teuthology.orchestra.run.smithi040.stdout:mgr advanced debug_ms 1/1 2024-09-21T01:49:16.174 INFO:teuthology.orchestra.run.smithi040.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced debug_mds 20/20 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced debug_ms 2/2 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds dev mds_debug_frag true 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds dev mds_debug_scatterstat true 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds dev mds_verify_scatter true 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced client_mount_timeout 600 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced debug_client 20/20 2024-09-21T01:49:16.175 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced debug_ms 1/1 2024-09-21T01:49:16.176 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T01:49:16.176 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T01:49:16.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.174+0000 7efdd0415640 1 -- 172.21.15.40:0/2336938695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc80cdbf0 msgr2=0x7efdc80cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.174+0000 7efdd0415640 1 --2- 172.21.15.40:0/2336938695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc80cdbf0 0x7efdc80cabb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efdbc034040 tx=0x7efdbc0038a0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.174+0000 7efdd0415640 1 -- 172.21.15.40:0/2336938695 shutdown_connections 2024-09-21T01:49:16.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.174+0000 7efdd0415640 1 --2- 172.21.15.40:0/2336938695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efdc815b900 0x7efdc809d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.174+0000 7efdd0415640 1 --2- 172.21.15.40:0/2336938695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdc80cdbf0 0x7efdc80cabb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.174+0000 7efdd0415640 1 --2- 172.21.15.40:0/2336938695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc809aa30 0x7efdc81f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.174+0000 7efdd0415640 1 -- 172.21.15.40:0/2336938695 >> 172.21.15.40:0/2336938695 conn(0x7efdc8074170 msgr2=0x7efdc815af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:16.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.174+0000 7efdd0415640 1 -- 172.21.15.40:0/2336938695 shutdown_connections 2024-09-21T01:49:16.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.174+0000 7efdd0415640 1 -- 172.21.15.40:0/2336938695 wait complete. 2024-09-21T01:49:16.185 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T01:49:16.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T01:49:16.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.301+0000 7ff97e18a640 1 -- 172.21.15.40:0/2742660703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff964004d40 msgr2=0x7ff964005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.301+0000 7ff97e18a640 1 --2- 172.21.15.40:0/2742660703 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff964004d40 0x7ff964005150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff970006fd0 tx=0x7ff964005830 comp rx=0 tx=0).stop 2024-09-21T01:49:16.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.301+0000 7ff977fff640 1 -- 172.21.15.40:0/2742660703 reap_dead start 2024-09-21T01:49:16.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.302+0000 7ff97e18a640 1 -- 172.21.15.40:0/2742660703 shutdown_connections 2024-09-21T01:49:16.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.302+0000 7ff97e18a640 1 -- 172.21.15.40:0/2742660703 >> 172.21.15.40:0/2742660703 conn(0x7ff97806ea80 msgr2=0x7ff9780b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:16.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.302+0000 7ff97e18a640 1 -- 172.21.15.40:0/2742660703 shutdown_connections 2024-09-21T01:49:16.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.302+0000 7ff97e18a640 1 -- 172.21.15.40:0/2742660703 wait complete. 2024-09-21T01:49:16.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.303+0000 7ff97e18a640 1 Processor -- start 2024-09-21T01:49:16.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.304+0000 7ff97e18a640 1 -- start start 2024-09-21T01:49:16.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff97e18a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff964004d40 0x7ff9781536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:16.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff97e18a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9781461d0 0x7ff978152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:16.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff97e18a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9781465e0 0x7ff978152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:16.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff97e18a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780b0ff0 con 0x7ff9781465e0 2024-09-21T01:49:16.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff97e18a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780b0e70 con 0x7ff9781461d0 2024-09-21T01:49:16.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff97e18a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7ff97806cde0 con 0x7ff964004d40 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff977fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9781465e0 0x7ff978152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff977fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9781465e0 0x7ff978152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38696/0 (socket says 172.21.15.40:38696) 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff977fff640 1 -- 172.21.15.40:0/1397497949 learned_addr learned my addr 172.21.15.40:0/1397497949 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff9777fe640 1 --2- 172.21.15.40:0/1397497949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff964004d40 0x7ff9781536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff96effd640 1 --2- 172.21.15.40:0/1397497949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9781461d0 0x7ff978152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff977fff640 1 -- 172.21.15.40:0/1397497949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff964004d40 msgr2=0x7ff9781536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff977fff640 1 --2- 172.21.15.40:0/1397497949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff964004d40 0x7ff9781536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff977fff640 1 -- 172.21.15.40:0/1397497949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9781461d0 msgr2=0x7ff978152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff977fff640 1 --2- 172.21.15.40:0/1397497949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9781461d0 0x7ff978152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff977fff640 1 -- 172.21.15.40:0/1397497949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff978153be0 con 0x7ff9781465e0 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.305+0000 7ff977fff640 1 --2- 172.21.15.40:0/1397497949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9781465e0 0x7ff978152fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff97002b490 tx=0x7ff970004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.306+0000 7ff974ff9640 1 -- 172.21.15.40:0/1397497949 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff968009720 con 0x7ff9781465e0 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.306+0000 7ff974ff9640 1 -- 172.21.15.40:0/1397497949 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff97002bce0 con 0x7ff9781465e0 2024-09-21T01:49:16.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.306+0000 7ff974ff9640 1 -- 172.21.15.40:0/1397497949 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9700062d0 con 0x7ff9781465e0 2024-09-21T01:49:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.306+0000 7ff97e18a640 1 -- 172.21.15.40:0/1397497949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9781540f0 con 0x7ff9781465e0 2024-09-21T01:49:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.306+0000 7ff97e18a640 1 -- 172.21.15.40:0/1397497949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9781546b0 con 0x7ff9781465e0 2024-09-21T01:49:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.306+0000 7ff974ff9640 1 -- 172.21.15.40:0/1397497949 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff970006800 con 0x7ff9781465e0 2024-09-21T01:49:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.306+0000 7ff974ff9640 1 -- 172.21.15.40:0/1397497949 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff97003e6c0 con 0x7ff9781465e0 2024-09-21T01:49:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.307+0000 7ff97e18a640 1 -- 172.21.15.40:0/1397497949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff978153e60 con 0x7ff9781465e0 2024-09-21T01:49:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.309+0000 7ff974ff9640 1 -- 172.21.15.40:0/1397497949 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff97003e910 con 0x7ff9781465e0 2024-09-21T01:49:16.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.376+0000 7ff97e18a640 1 -- 172.21.15.40:0/1397497949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff9780b26c0 con 0x7ff9781465e0 2024-09-21T01:49:16.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.377+0000 7ff974ff9640 1 -- 172.21.15.40:0/1397497949 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff97003eaf0 con 0x7ff9781465e0 2024-09-21T01:49:16.378 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-09-21T01:49:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.378+0000 7ff97e18a640 1 -- 172.21.15.40:0/1397497949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9781465e0 msgr2=0x7ff978152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.378+0000 7ff97e18a640 1 --2- 172.21.15.40:0/1397497949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9781465e0 0x7ff978152fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff97002b490 tx=0x7ff970004bb0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.378+0000 7ff97e18a640 1 -- 172.21.15.40:0/1397497949 shutdown_connections 2024-09-21T01:49:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.378+0000 7ff97e18a640 1 --2- 172.21.15.40:0/1397497949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9781465e0 0x7ff978152fd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.378+0000 7ff97e18a640 1 --2- 172.21.15.40:0/1397497949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff9781461d0 0x7ff978152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.378+0000 7ff97e18a640 1 --2- 172.21.15.40:0/1397497949 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff964004d40 0x7ff9781536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.378+0000 7ff97e18a640 1 -- 172.21.15.40:0/1397497949 >> 172.21.15.40:0/1397497949 conn(0x7ff97806ea80 msgr2=0x7ff97814f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.379+0000 7ff97e18a640 1 -- 172.21.15.40:0/1397497949 shutdown_connections 2024-09-21T01:49:16.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:16.379+0000 7ff97e18a640 1 -- 172.21.15.40:0/1397497949 wait complete. 2024-09-21T01:49:16.390 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T01:49:16.390 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T01:49:16.390 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:16.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T01:49:16.415 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:16.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T01:49:16.481 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:16.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T01:49:16.548 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:16.548 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T01:49:16.614 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:16.614 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T01:49:16.639 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:16.639 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T01:49:16.704 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:16.704 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T01:49:16.768 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:49:16.768 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T01:49:16.832 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new b3d756bf-fe80-4681-a411-7c9c5836ac69 0 2024-09-21T01:49:16.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.987+0000 7f0409a94640 1 -- 172.21.15.139:0/425827876 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 msgr2=0x7f04040ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.987+0000 7f0409a94640 1 --2- 172.21.15.139:0/425827876 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 0x7f04040ae1b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f04040d2320 tx=0x7f03fc02a850 comp rx=0 tx=0).stop 2024-09-21T01:49:16.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.987+0000 7f0409a94640 1 -- 172.21.15.139:0/425827876 shutdown_connections 2024-09-21T01:49:16.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.987+0000 7f0409a94640 1 --2- 172.21.15.139:0/425827876 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 0x7f04040ae1b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.987+0000 7f0409a94640 1 -- 172.21.15.139:0/425827876 >> 172.21.15.139:0/425827876 conn(0x7f0404074170 msgr2=0x7f04040b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:16.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.987+0000 7f0409a94640 1 -- 172.21.15.139:0/425827876 shutdown_connections 2024-09-21T01:49:16.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.987+0000 7f0409a94640 1 -- 172.21.15.139:0/425827876 wait complete. 2024-09-21T01:49:16.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.990+0000 7f0409a94640 1 Processor -- start 2024-09-21T01:49:16.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.991+0000 7f0409a94640 1 -- start start 2024-09-21T01:49:16.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f0409a94640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 0x7f040415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f0409a94640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040415b900 0x7f040415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f0409a94640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f040415a6a0 0x7f04041e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f0409a94640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04040cd360 con 0x7f040415b900 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f0409a94640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f04040cd1e0 con 0x7f040415a6a0 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f0409a94640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f04040cd4e0 con 0x7f040409aa30 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f04037fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 0x7f040415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f0403fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f040415a6a0 0x7f04041e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f04037fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 0x7f040415dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:55972/0 (socket says 172.21.15.139:55972) 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f04037fe640 1 -- 172.21.15.139:0/1908153974 learned_addr learned my addr 172.21.15.139:0/1908153974 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f0402ffd640 1 --2- 172.21.15.139:0/1908153974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040415b900 0x7f040415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f04037fe640 1 -- 172.21.15.139:0/1908153974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f040415a6a0 msgr2=0x7f04041e6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f04037fe640 1 --2- 172.21.15.139:0/1908153974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f040415a6a0 0x7f04041e6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.995 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f04037fe640 1 -- 172.21.15.139:0/1908153974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040415b900 msgr2=0x7f040415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f04037fe640 1 --2- 172.21.15.139:0/1908153974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040415b900 0x7f040415a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f04037fe640 1 -- 172.21.15.139:0/1908153974 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04041f5c40 con 0x7f040409aa30 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.993+0000 7f04037fe640 1 --2- 172.21.15.139:0/1908153974 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 0x7f040415dc30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f03f400c390 tx=0x7f03f400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.994+0000 7f03ebfff640 1 -- 172.21.15.139:0/1908153974 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4011790 con 0x7f040409aa30 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.994+0000 7f03ebfff640 1 -- 172.21.15.139:0/1908153974 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03f4017070 con 0x7f040409aa30 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.994+0000 7f0409a94640 1 -- 172.21.15.139:0/1908153974 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04041f5f20 con 0x7f040409aa30 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.994+0000 7f03ebfff640 1 -- 172.21.15.139:0/1908153974 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4011ce0 con 0x7f040409aa30 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.994+0000 7f0409a94640 1 -- 172.21.15.139:0/1908153974 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04041f64e0 con 0x7f040409aa30 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.994+0000 7f03ebfff640 1 -- 172.21.15.139:0/1908153974 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03f401c460 con 0x7f040409aa30 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.994+0000 7f03ebfff640 1 -- 172.21.15.139:0/1908153974 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f03f40127e0 con 0x7f040409aa30 2024-09-21T01:49:16.996 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.995+0000 7f0409a94640 1 -- 172.21.15.139:0/1908153974 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04040ae1b0 con 0x7f040409aa30 2024-09-21T01:49:16.997 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:16.997+0000 7f03ebfff640 1 -- 172.21.15.139:0/1908153974 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f03f4012a30 con 0x7f040409aa30 2024-09-21T01:49:17.065 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.065+0000 7f0409a94640 1 -- 172.21.15.139:0/1908153974 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b3d756bf-fe80-4681-a411-7c9c5836ac69", "id": 0} v 0) -- 0x7f04040b6420 con 0x7f040409aa30 2024-09-21T01:49:17.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.073+0000 7f03ebfff640 1 -- 172.21.15.139:0/1908153974 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3d756bf-fe80-4681-a411-7c9c5836ac69", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f03f4012c10 con 0x7f040409aa30 2024-09-21T01:49:17.073 INFO:teuthology.orchestra.run.smithi139.stdout:0 2024-09-21T01:49:17.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.074+0000 7f0409a94640 1 -- 172.21.15.139:0/1908153974 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 msgr2=0x7f040415dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.074+0000 7f0409a94640 1 --2- 172.21.15.139:0/1908153974 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 0x7f040415dc30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f03f400c390 tx=0x7f03f400c850 comp rx=0 tx=0).stop 2024-09-21T01:49:17.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.074+0000 7f0409a94640 1 -- 172.21.15.139:0/1908153974 shutdown_connections 2024-09-21T01:49:17.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.074+0000 7f0409a94640 1 --2- 172.21.15.139:0/1908153974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f040415a6a0 0x7f04041e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.074+0000 7f0409a94640 1 --2- 172.21.15.139:0/1908153974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f040415b900 0x7f040415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.074+0000 7f0409a94640 1 --2- 172.21.15.139:0/1908153974 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f040409aa30 0x7f040415dc30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.074+0000 7f0409a94640 1 -- 172.21.15.139:0/1908153974 >> 172.21.15.139:0/1908153974 conn(0x7f0404074170 msgr2=0x7f040415b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.074+0000 7f0409a94640 1 -- 172.21.15.139:0/1908153974 shutdown_connections 2024-09-21T01:49:17.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.074+0000 7f0409a94640 1 -- 172.21.15.139:0/1908153974 wait complete. 2024-09-21T01:49:17.085 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new fcc27a57-68ad-42d6-b808-1f1bea92ee09 1 2024-09-21T01:49:17.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.199+0000 7ff47f8e5640 1 -- 172.21.15.139:0/963515268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4780b2520 msgr2=0x7ff478166520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.199+0000 7ff47f8e5640 1 --2- 172.21.15.139:0/963515268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4780b2520 0x7ff478166520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4780b3760 tx=0x7ff47002aa90 comp rx=0 tx=0).stop 2024-09-21T01:49:17.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.199+0000 7ff47f8e5640 1 -- 172.21.15.139:0/963515268 shutdown_connections 2024-09-21T01:49:17.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.199+0000 7ff47f8e5640 1 --2- 172.21.15.139:0/963515268 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4780b2520 0x7ff478166520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.199+0000 7ff47f8e5640 1 -- 172.21.15.139:0/963515268 >> 172.21.15.139:0/963515268 conn(0x7ff47806ea80 msgr2=0x7ff4780b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:17.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.199+0000 7ff47f8e5640 1 -- 172.21.15.139:0/963515268 shutdown_connections 2024-09-21T01:49:17.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.199+0000 7ff47f8e5640 1 -- 172.21.15.139:0/963515268 wait complete. 2024-09-21T01:49:17.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.201+0000 7ff47f8e5640 1 Processor -- start 2024-09-21T01:49:17.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.201+0000 7ff47f8e5640 1 -- start start 2024-09-21T01:49:17.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47f8e5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff47809aa30 0x7ff4780b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47f8e5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4780b2520 0x7ff4781523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47f8e5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff47815b8c0 0x7ff478147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47f8e5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff478166e50 con 0x7ff4780b2520 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47f8e5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff478166cd0 con 0x7ff47809aa30 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47f8e5640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7ff478166fd0 con 0x7ff47815b8c0 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47d681640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff47809aa30 0x7ff4780b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47d681640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff47809aa30 0x7ff4780b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:59388/0 (socket says 172.21.15.139:59388) 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47d681640 1 -- 172.21.15.139:0/1012047584 learned_addr learned my addr 172.21.15.139:0/1012047584 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47de82640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff47815b8c0 0x7ff478147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47ce80640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4780b2520 0x7ff4781523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47d681640 1 -- 172.21.15.139:0/1012047584 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff47815b8c0 msgr2=0x7ff478147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.204 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47d681640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff47815b8c0 0x7ff478147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47d681640 1 -- 172.21.15.139:0/1012047584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4780b2520 msgr2=0x7ff4781523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47d681640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4780b2520 0x7ff4781523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47d681640 1 -- 172.21.15.139:0/1012047584 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff478152910 con 0x7ff47809aa30 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.202+0000 7ff47de82640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff47815b8c0 0x7ff478147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.203+0000 7ff47d681640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff47809aa30 0x7ff4780b0870 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff46800c400 tx=0x7ff46800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.203+0000 7ff46dffb640 1 -- 172.21.15.139:0/1012047584 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468017070 con 0x7ff47809aa30 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.203+0000 7ff46dffb640 1 -- 172.21.15.139:0/1012047584 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4680053c0 con 0x7ff47809aa30 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.203+0000 7ff46dffb640 1 -- 172.21.15.139:0/1012047584 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468003850 con 0x7ff47809aa30 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.203+0000 7ff47f8e5640 1 -- 172.21.15.139:0/1012047584 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff478145ff0 con 0x7ff47809aa30 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.203+0000 7ff46dffb640 1 -- 172.21.15.139:0/1012047584 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff46801a070 con 0x7ff47809aa30 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.203+0000 7ff47f8e5640 1 -- 172.21.15.139:0/1012047584 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4781465b0 con 0x7ff47809aa30 2024-09-21T01:49:17.205 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.203+0000 7ff46dffb640 1 -- 172.21.15.139:0/1012047584 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff468011c70 con 0x7ff47809aa30 2024-09-21T01:49:17.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.204+0000 7ff47f8e5640 1 -- 172.21.15.139:0/1012047584 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4780b1e10 con 0x7ff47809aa30 2024-09-21T01:49:17.206 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.206+0000 7ff46dffb640 1 -- 172.21.15.139:0/1012047584 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff468022070 con 0x7ff47809aa30 2024-09-21T01:49:17.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.274+0000 7ff47f8e5640 1 -- 172.21.15.139:0/1012047584 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fcc27a57-68ad-42d6-b808-1f1bea92ee09", "id": 1} v 0) -- 0x7ff478144b90 con 0x7ff47809aa30 2024-09-21T01:49:17.278 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.278+0000 7ff46dffb640 1 -- 172.21.15.139:0/1012047584 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fcc27a57-68ad-42d6-b808-1f1bea92ee09", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff468011e70 con 0x7ff47809aa30 2024-09-21T01:49:17.279 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-21T01:49:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.279+0000 7ff47f8e5640 1 -- 172.21.15.139:0/1012047584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff47809aa30 msgr2=0x7ff4780b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.279+0000 7ff47f8e5640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff47809aa30 0x7ff4780b0870 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff46800c400 tx=0x7ff46800c8c0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.279+0000 7ff47f8e5640 1 -- 172.21.15.139:0/1012047584 shutdown_connections 2024-09-21T01:49:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.279+0000 7ff47f8e5640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff47815b8c0 0x7ff478147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.279+0000 7ff47f8e5640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4780b2520 0x7ff4781523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.279+0000 7ff47f8e5640 1 --2- 172.21.15.139:0/1012047584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff47809aa30 0x7ff4780b0870 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.279+0000 7ff47f8e5640 1 -- 172.21.15.139:0/1012047584 >> 172.21.15.139:0/1012047584 conn(0x7ff47806ea80 msgr2=0x7ff478151c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.279+0000 7ff47f8e5640 1 -- 172.21.15.139:0/1012047584 shutdown_connections 2024-09-21T01:49:17.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.279+0000 7ff47f8e5640 1 -- 172.21.15.139:0/1012047584 wait complete. 2024-09-21T01:49:17.290 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 604e9c00-8c79-4707-8e14-d77ba3f49e2c 2 2024-09-21T01:49:17.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.403+0000 7f449c01d640 1 -- 172.21.15.139:0/2051486884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 msgr2=0x7f44940ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.403+0000 7f449c01d640 1 --2- 172.21.15.139:0/2051486884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 0x7f44940ae1b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f44940d2320 tx=0x7f448402a560 comp rx=0 tx=0).stop 2024-09-21T01:49:17.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.403+0000 7f449c01d640 1 -- 172.21.15.139:0/2051486884 shutdown_connections 2024-09-21T01:49:17.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.403+0000 7f449c01d640 1 --2- 172.21.15.139:0/2051486884 >> v2:172.21.15.40:3300/0 conn(0x7f449409aa30 0x7f44940cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.403+0000 7f449c01d640 1 --2- 172.21.15.139:0/2051486884 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f44940cdbf0 0x7f44940cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.403+0000 7f449c01d640 1 --2- 172.21.15.139:0/2051486884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 0x7f44940ae1b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.403+0000 7f449c01d640 1 -- 172.21.15.139:0/2051486884 >> 172.21.15.139:0/2051486884 conn(0x7f4494074170 msgr2=0x7f44940b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:17.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.403+0000 7f449c01d640 1 -- 172.21.15.139:0/2051486884 shutdown_connections 2024-09-21T01:49:17.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.403+0000 7f449c01d640 1 -- 172.21.15.139:0/2051486884 wait complete. 2024-09-21T01:49:17.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.405+0000 7f449c01d640 1 Processor -- start 2024-09-21T01:49:17.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.405+0000 7f449c01d640 1 -- start start 2024-09-21T01:49:17.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f449c01d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f449409aa30 0x7f44941f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f449c01d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f44940cdbf0 0x7f44940c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f449c01d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 0x7f449406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f449c01d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44940cce60 con 0x7f449409aa30 2024-09-21T01:49:17.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f449c01d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f44940ccce0 con 0x7f449415b900 2024-09-21T01:49:17.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f449c01d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f44940ccfe0 con 0x7f44940cdbf0 2024-09-21T01:49:17.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f44995b8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f44940cdbf0 0x7f44940c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f449a5ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 0x7f449406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f44995b8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f44940cdbf0 0x7f44940c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:56008/0 (socket says 172.21.15.139:56008) 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f449a5ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 0x7f449406cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:59400/0 (socket says 172.21.15.139:59400) 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.406+0000 7f44995b8640 1 -- 172.21.15.139:0/3547742237 learned_addr learned my addr 172.21.15.139:0/3547742237 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f4499db9640 1 --2- 172.21.15.139:0/3547742237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f449409aa30 0x7f44941f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f449a5ba640 1 -- 172.21.15.139:0/3547742237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f44940cdbf0 msgr2=0x7f44940c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f449a5ba640 1 --2- 172.21.15.139:0/3547742237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f44940cdbf0 0x7f44940c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f449a5ba640 1 -- 172.21.15.139:0/3547742237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f449409aa30 msgr2=0x7f44941f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f449a5ba640 1 --2- 172.21.15.139:0/3547742237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f449409aa30 0x7f44941f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f449a5ba640 1 -- 172.21.15.139:0/3547742237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44941f7660 con 0x7f449415b900 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f449a5ba640 1 --2- 172.21.15.139:0/3547742237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 0x7f449406cfc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4494074980 tx=0x7f448c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f448a7fc640 1 -- 172.21.15.139:0/3547742237 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c003970 con 0x7f449415b900 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f448a7fc640 1 -- 172.21.15.139:0/3547742237 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f448c003b10 con 0x7f449415b900 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f449c01d640 1 -- 172.21.15.139:0/3547742237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44941f7940 con 0x7f449415b900 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f448a7fc640 1 -- 172.21.15.139:0/3547742237 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c004020 con 0x7f449415b900 2024-09-21T01:49:17.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f449c01d640 1 -- 172.21.15.139:0/3547742237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449415cfb0 con 0x7f449415b900 2024-09-21T01:49:17.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f448a7fc640 1 -- 172.21.15.139:0/3547742237 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f448c004550 con 0x7f449415b900 2024-09-21T01:49:17.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.407+0000 7f448a7fc640 1 -- 172.21.15.139:0/3547742237 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f448c018850 con 0x7f449415b900 2024-09-21T01:49:17.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.408+0000 7f449c01d640 1 -- 172.21.15.139:0/3547742237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44940afae0 con 0x7f449415b900 2024-09-21T01:49:17.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.410+0000 7f448a7fc640 1 -- 172.21.15.139:0/3547742237 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f448c038860 con 0x7f449415b900 2024-09-21T01:49:17.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.480+0000 7f449c01d640 1 -- 172.21.15.139:0/3547742237 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "604e9c00-8c79-4707-8e14-d77ba3f49e2c", "id": 2} v 0) -- 0x7f449415cda0 con 0x7f449415b900 2024-09-21T01:49:17.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.485+0000 7f448a7fc640 1 -- 172.21.15.139:0/3547742237 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "604e9c00-8c79-4707-8e14-d77ba3f49e2c", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f448c026030 con 0x7f449415b900 2024-09-21T01:49:17.485 INFO:teuthology.orchestra.run.smithi139.stdout:2 2024-09-21T01:49:17.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.486+0000 7f449c01d640 1 -- 172.21.15.139:0/3547742237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 msgr2=0x7f449406cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.486+0000 7f449c01d640 1 --2- 172.21.15.139:0/3547742237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 0x7f449406cfc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4494074980 tx=0x7f448c00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.486+0000 7f449c01d640 1 -- 172.21.15.139:0/3547742237 shutdown_connections 2024-09-21T01:49:17.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.486+0000 7f449c01d640 1 --2- 172.21.15.139:0/3547742237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f449415b900 0x7f449406cfc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.486+0000 7f449c01d640 1 --2- 172.21.15.139:0/3547742237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f44940cdbf0 0x7f44940c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.486+0000 7f449c01d640 1 --2- 172.21.15.139:0/3547742237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f449409aa30 0x7f44941f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.486+0000 7f449c01d640 1 -- 172.21.15.139:0/3547742237 >> 172.21.15.139:0/3547742237 conn(0x7f4494074170 msgr2=0x7f44940b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:17.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.486+0000 7f449c01d640 1 -- 172.21.15.139:0/3547742237 shutdown_connections 2024-09-21T01:49:17.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.486+0000 7f449c01d640 1 -- 172.21.15.139:0/3547742237 wait complete. 2024-09-21T01:49:17.496 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new c9691d72-0da9-4ad5-ac26-2db91337ba9b 3 2024-09-21T01:49:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.609+0000 7f8115adc640 1 -- 172.21.15.139:0/3680931467 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 msgr2=0x7f81100ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.609+0000 7f8115adc640 1 --2- 172.21.15.139:0/3680931467 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 0x7f81100ccad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8108005fd0 tx=0x7f810802aa90 comp rx=0 tx=0).stop 2024-09-21T01:49:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.609+0000 7f8115adc640 1 -- 172.21.15.139:0/3680931467 shutdown_connections 2024-09-21T01:49:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.609+0000 7f8115adc640 1 --2- 172.21.15.139:0/3680931467 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 0x7f81100ccad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.609+0000 7f8115adc640 1 --2- 172.21.15.139:0/3680931467 >> v2:172.21.15.40:3300/0 conn(0x7f81100cf520 0x7f81100ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.609+0000 7f8115adc640 1 -- 172.21.15.139:0/3680931467 >> 172.21.15.139:0/3680931467 conn(0x7f8110074170 msgr2=0x7f81100b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.609+0000 7f8115adc640 1 -- 172.21.15.139:0/3680931467 shutdown_connections 2024-09-21T01:49:17.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.609+0000 7f8115adc640 1 -- 172.21.15.139:0/3680931467 wait complete. 2024-09-21T01:49:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.611+0000 7f8115adc640 1 Processor -- start 2024-09-21T01:49:17.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.611+0000 7f8115adc640 1 -- start start 2024-09-21T01:49:17.613 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f8115adc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 0x7f8110157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f8115adc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811015b900 0x7f811014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f8115adc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81100b2320 0x7f81100b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f8115adc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f81100cd190 con 0x7f811015b900 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f8115adc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f81100cd010 con 0x7f81100b2320 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f8115adc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f81100cd310 con 0x7f811009aa30 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f810f7fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 0x7f8110157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f810ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81100b2320 0x7f81100b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f810f7fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 0x7f8110157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:56026/0 (socket says 172.21.15.139:56026) 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f810ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81100b2320 0x7f81100b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:59402/0 (socket says 172.21.15.139:59402) 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f810f7fe640 1 -- 172.21.15.139:0/1790046491 learned_addr learned my addr 172.21.15.139:0/1790046491 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.612+0000 7f8107fff640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811015b900 0x7f811014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810f7fe640 1 -- 172.21.15.139:0/1790046491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81100b2320 msgr2=0x7f81100b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.614 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810f7fe640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81100b2320 0x7f81100b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810f7fe640 1 -- 172.21.15.139:0/1790046491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811015b900 msgr2=0x7f811014f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810f7fe640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811015b900 0x7f811014f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810f7fe640 1 -- 172.21.15.139:0/1790046491 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8110156b70 con 0x7f811009aa30 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f8107fff640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811015b900 0x7f811014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810ffff640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81100b2320 0x7f81100b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810f7fe640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 0x7f8110157610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f810000c3a0 tx=0x7f810000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810cff9640 1 -- 172.21.15.139:0/1790046491 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81000052d0 con 0x7f811009aa30 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810cff9640 1 -- 172.21.15.139:0/1790046491 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8100007020 con 0x7f811009aa30 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f8115adc640 1 -- 172.21.15.139:0/1790046491 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811015c7c0 con 0x7f811009aa30 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810cff9640 1 -- 172.21.15.139:0/1790046491 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100007470 con 0x7f811009aa30 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f8115adc640 1 -- 172.21.15.139:0/1790046491 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81101570f0 con 0x7f811009aa30 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810cff9640 1 -- 172.21.15.139:0/1790046491 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f81000067d0 con 0x7f811009aa30 2024-09-21T01:49:17.615 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.613+0000 7f810cff9640 1 -- 172.21.15.139:0/1790046491 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8100003b90 con 0x7f811009aa30 2024-09-21T01:49:17.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.614+0000 7f8115adc640 1 -- 172.21.15.139:0/1790046491 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81100ccad0 con 0x7f811009aa30 2024-09-21T01:49:17.616 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.616+0000 7f810cff9640 1 -- 172.21.15.139:0/1790046491 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8100003e00 con 0x7f811009aa30 2024-09-21T01:49:17.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.687+0000 7f8115adc640 1 -- 172.21.15.139:0/1790046491 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c9691d72-0da9-4ad5-ac26-2db91337ba9b", "id": 3} v 0) -- 0x7f81100ae9b0 con 0x7f811009aa30 2024-09-21T01:49:17.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.691+0000 7f810cff9640 1 -- 172.21.15.139:0/1790046491 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9691d72-0da9-4ad5-ac26-2db91337ba9b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8100007610 con 0x7f811009aa30 2024-09-21T01:49:17.691 INFO:teuthology.orchestra.run.smithi139.stdout:3 2024-09-21T01:49:17.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.692+0000 7f8115adc640 1 -- 172.21.15.139:0/1790046491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 msgr2=0x7f8110157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.692+0000 7f8115adc640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 0x7f8110157610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f810000c3a0 tx=0x7f810000c860 comp rx=0 tx=0).stop 2024-09-21T01:49:17.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.692+0000 7f8115adc640 1 -- 172.21.15.139:0/1790046491 shutdown_connections 2024-09-21T01:49:17.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.692+0000 7f8115adc640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81100b2320 0x7f81100b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.692+0000 7f8115adc640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f811015b900 0x7f811014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.692+0000 7f8115adc640 1 --2- 172.21.15.139:0/1790046491 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f811009aa30 0x7f8110157610 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.692+0000 7f8115adc640 1 -- 172.21.15.139:0/1790046491 >> 172.21.15.139:0/1790046491 conn(0x7f8110074170 msgr2=0x7f81100af540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:17.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.692+0000 7f8115adc640 1 -- 172.21.15.139:0/1790046491 shutdown_connections 2024-09-21T01:49:17.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.692+0000 7f8115adc640 1 -- 172.21.15.139:0/1790046491 wait complete. 2024-09-21T01:49:17.706 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d 4 2024-09-21T01:49:17.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.818+0000 7f2957dad640 1 -- 172.21.15.139:0/1414257285 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015c9b0 msgr2=0x7f29500ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.818+0000 7f2957dad640 1 --2- 172.21.15.139:0/1414257285 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015c9b0 0x7f29500ccfa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f294c009860 tx=0x7f294c02a5a0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.818+0000 7f2957dad640 1 -- 172.21.15.139:0/1414257285 shutdown_connections 2024-09-21T01:49:17.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.818+0000 7f2957dad640 1 --2- 172.21.15.139:0/1414257285 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015c9b0 0x7f29500ccfa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.818+0000 7f2957dad640 1 -- 172.21.15.139:0/1414257285 >> 172.21.15.139:0/1414257285 conn(0x7f29500cdc60 msgr2=0x7f29500ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:17.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.818+0000 7f2957dad640 1 -- 172.21.15.139:0/1414257285 shutdown_connections 2024-09-21T01:49:17.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.818+0000 7f2957dad640 1 -- 172.21.15.139:0/1414257285 wait complete. 2024-09-21T01:49:17.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.820+0000 7f2957dad640 1 Processor -- start 2024-09-21T01:49:17.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.820+0000 7f2957dad640 1 -- start start 2024-09-21T01:49:17.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.821+0000 7f2957dad640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2950073e70 0x7f2950142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.821+0000 7f2957dad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295015c9b0 0x7f29501515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.821+0000 7f2957dad640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015ff30 0x7f2950151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:17.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.821+0000 7f2957dad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2950166af0 con 0x7f295015c9b0 2024-09-21T01:49:17.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.821+0000 7f2957dad640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2950166970 con 0x7f2950073e70 2024-09-21T01:49:17.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.821+0000 7f2957dad640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f2950166c70 con 0x7f295015ff30 2024-09-21T01:49:17.823 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.821+0000 7f295634a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015ff30 0x7f2950151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.821+0000 7f2955b49640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2950073e70 0x7f2950142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f295634a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015ff30 0x7f2950151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:56032/0 (socket says 172.21.15.139:56032) 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f2955b49640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2950073e70 0x7f2950142920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:59416/0 (socket says 172.21.15.139:59416) 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f295634a640 1 -- 172.21.15.139:0/4172656744 learned_addr learned my addr 172.21.15.139:0/4172656744 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f2955348640 1 --2- 172.21.15.139:0/4172656744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295015c9b0 0x7f29501515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f295634a640 1 -- 172.21.15.139:0/4172656744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2950073e70 msgr2=0x7f2950142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f295634a640 1 --2- 172.21.15.139:0/4172656744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2950073e70 0x7f2950142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f295634a640 1 -- 172.21.15.139:0/4172656744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295015c9b0 msgr2=0x7f29501515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f295634a640 1 --2- 172.21.15.139:0/4172656744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295015c9b0 0x7f29501515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f295634a640 1 -- 172.21.15.139:0/4172656744 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2950152370 con 0x7f295015ff30 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f295634a640 1 --2- 172.21.15.139:0/4172656744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015ff30 0x7f2950151af0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f294800c730 tx=0x7f294800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f29427fc640 1 -- 172.21.15.139:0/4172656744 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948003b70 con 0x7f295015ff30 2024-09-21T01:49:17.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f29427fc640 1 -- 172.21.15.139:0/4172656744 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2948003d10 con 0x7f295015ff30 2024-09-21T01:49:17.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f2957dad640 1 -- 172.21.15.139:0/4172656744 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2950157000 con 0x7f295015ff30 2024-09-21T01:49:17.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f29427fc640 1 -- 172.21.15.139:0/4172656744 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294800aab0 con 0x7f295015ff30 2024-09-21T01:49:17.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f2957dad640 1 -- 172.21.15.139:0/4172656744 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29501575c0 con 0x7f295015ff30 2024-09-21T01:49:17.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f29427fc640 1 -- 172.21.15.139:0/4172656744 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f294800ac50 con 0x7f295015ff30 2024-09-21T01:49:17.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.822+0000 7f29427fc640 1 -- 172.21.15.139:0/4172656744 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2948012b60 con 0x7f295015ff30 2024-09-21T01:49:17.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.823+0000 7f2957dad640 1 -- 172.21.15.139:0/4172656744 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29500b23e0 con 0x7f295015ff30 2024-09-21T01:49:17.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.825+0000 7f29427fc640 1 -- 172.21.15.139:0/4172656744 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f29500b23e0 con 0x7f295015ff30 2024-09-21T01:49:17.896 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.896+0000 7f2957dad640 1 -- 172.21.15.139:0/4172656744 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d", "id": 4} v 0) -- 0x7f29500ccfa0 con 0x7f295015ff30 2024-09-21T01:49:17.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.900+0000 7f29427fc640 1 -- 172.21.15.139:0/4172656744 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f2948012650 con 0x7f295015ff30 2024-09-21T01:49:17.900 INFO:teuthology.orchestra.run.smithi139.stdout:4 2024-09-21T01:49:17.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.901+0000 7f2957dad640 1 -- 172.21.15.139:0/4172656744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015ff30 msgr2=0x7f2950151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:17.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.901+0000 7f2957dad640 1 --2- 172.21.15.139:0/4172656744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015ff30 0x7f2950151af0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f294800c730 tx=0x7f294800cbf0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.901+0000 7f2957dad640 1 -- 172.21.15.139:0/4172656744 shutdown_connections 2024-09-21T01:49:17.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.901+0000 7f2957dad640 1 --2- 172.21.15.139:0/4172656744 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f295015ff30 0x7f2950151af0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.901+0000 7f2957dad640 1 --2- 172.21.15.139:0/4172656744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f295015c9b0 0x7f29501515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.901+0000 7f2957dad640 1 --2- 172.21.15.139:0/4172656744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2950073e70 0x7f2950142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:17.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.901+0000 7f2957dad640 1 -- 172.21.15.139:0/4172656744 >> 172.21.15.139:0/4172656744 conn(0x7f29500cdc60 msgr2=0x7f29500b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:17.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.901+0000 7f2957dad640 1 -- 172.21.15.139:0/4172656744 shutdown_connections 2024-09-21T01:49:17.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:17.901+0000 7f2957dad640 1 -- 172.21.15.139:0/4172656744 wait complete. 2024-09-21T01:49:17.912 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new e80ec918-dee3-44b5-823f-7c9010e4510d 5 2024-09-21T01:49:18.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.025+0000 7f6ddf92b640 1 -- 172.21.15.139:0/4183448514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd80b6100 msgr2=0x7f6dd80b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.025+0000 7f6ddf92b640 1 --2- 172.21.15.139:0/4183448514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd80b6100 0x7f6dd80b14f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8005fd0 tx=0x7f6dc802a5d0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.025+0000 7f6ddf92b640 1 -- 172.21.15.139:0/4183448514 shutdown_connections 2024-09-21T01:49:18.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.025+0000 7f6ddf92b640 1 --2- 172.21.15.139:0/4183448514 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd8162f60 0x7f6dd8165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.025+0000 7f6ddf92b640 1 --2- 172.21.15.139:0/4183448514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd80b6100 0x7f6dd80b14f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.025+0000 7f6ddf92b640 1 -- 172.21.15.139:0/4183448514 >> 172.21.15.139:0/4183448514 conn(0x7f6dd80d12a0 msgr2=0x7f6dd80d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:18.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.025+0000 7f6ddf92b640 1 -- 172.21.15.139:0/4183448514 shutdown_connections 2024-09-21T01:49:18.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.025+0000 7f6ddf92b640 1 -- 172.21.15.139:0/4183448514 wait complete. 2024-09-21T01:49:18.026 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.027+0000 7f6ddf92b640 1 Processor -- start 2024-09-21T01:49:18.027 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.027+0000 7f6ddf92b640 1 -- start start 2024-09-21T01:49:18.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddf92b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd80b6100 0x7f6dd81f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddf92b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd80b6680 0x7f6dd815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddf92b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd8162f60 0x7f6dd806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddf92b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd8165a40 con 0x7f6dd80b6680 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddf92b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd81658c0 con 0x7f6dd8162f60 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddf92b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd8165bc0 con 0x7f6dd80b6100 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddd6c7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd80b6100 0x7f6dd81f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6dddec8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd8162f60 0x7f6dd806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddd6c7640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd80b6100 0x7f6dd81f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:56046/0 (socket says 172.21.15.139:56046) 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddd6c7640 1 -- 172.21.15.139:0/2711113056 learned_addr learned my addr 172.21.15.139:0/2711113056 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddcec6640 1 --2- 172.21.15.139:0/2711113056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd80b6680 0x7f6dd815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddd6c7640 1 -- 172.21.15.139:0/2711113056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd8162f60 msgr2=0x7f6dd806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddd6c7640 1 --2- 172.21.15.139:0/2711113056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd8162f60 0x7f6dd806cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddd6c7640 1 -- 172.21.15.139:0/2711113056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd80b6680 msgr2=0x7f6dd815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddd6c7640 1 --2- 172.21.15.139:0/2711113056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd80b6680 0x7f6dd815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6ddd6c7640 1 -- 172.21.15.139:0/2711113056 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd8161a90 con 0x7f6dd80b6100 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.028+0000 7f6dddec8640 1 --2- 172.21.15.139:0/2711113056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd8162f60 0x7f6dd806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.029+0000 7f6ddd6c7640 1 --2- 172.21.15.139:0/2711113056 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd80b6100 0x7f6dd81f6590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400c400 tx=0x7f6dd400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.029+0000 7f6dcdffb640 1 -- 172.21.15.139:0/2711113056 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4017070 con 0x7f6dd80b6100 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.029+0000 7f6dcdffb640 1 -- 172.21.15.139:0/2711113056 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dd40035f0 con 0x7f6dd80b6100 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.029+0000 7f6ddf92b640 1 -- 172.21.15.139:0/2711113056 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd8161f30 con 0x7f6dd80b6100 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.029+0000 7f6dcdffb640 1 -- 172.21.15.139:0/2711113056 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4003a40 con 0x7f6dd80b6100 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.029+0000 7f6ddf92b640 1 -- 172.21.15.139:0/2711113056 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd81624f0 con 0x7f6dd80b6100 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.029+0000 7f6dcdffb640 1 -- 172.21.15.139:0/2711113056 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6dd401a070 con 0x7f6dd80b6100 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.029+0000 7f6dcdffb640 1 -- 172.21.15.139:0/2711113056 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f6dd4012980 con 0x7f6dd80b6100 2024-09-21T01:49:18.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.030+0000 7f6ddf92b640 1 -- 172.21.15.139:0/2711113056 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd80b0de0 con 0x7f6dd80b6100 2024-09-21T01:49:18.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.032+0000 7f6dcdffb640 1 -- 172.21.15.139:0/2711113056 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6dd4021020 con 0x7f6dd80b6100 2024-09-21T01:49:18.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.102+0000 7f6ddf92b640 1 -- 172.21.15.139:0/2711113056 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e80ec918-dee3-44b5-823f-7c9010e4510d", "id": 5} v 0) -- 0x7f6dd80cbf20 con 0x7f6dd80b6100 2024-09-21T01:49:18.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.107+0000 7f6dcdffb640 1 -- 172.21.15.139:0/2711113056 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e80ec918-dee3-44b5-823f-7c9010e4510d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f6dd4003d10 con 0x7f6dd80b6100 2024-09-21T01:49:18.107 INFO:teuthology.orchestra.run.smithi139.stdout:5 2024-09-21T01:49:18.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.108+0000 7f6ddf92b640 1 -- 172.21.15.139:0/2711113056 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd80b6100 msgr2=0x7f6dd81f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.108+0000 7f6ddf92b640 1 --2- 172.21.15.139:0/2711113056 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd80b6100 0x7f6dd81f6590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400c400 tx=0x7f6dd400c800 comp rx=0 tx=0).stop 2024-09-21T01:49:18.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.108+0000 7f6ddf92b640 1 -- 172.21.15.139:0/2711113056 shutdown_connections 2024-09-21T01:49:18.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.108+0000 7f6ddf92b640 1 --2- 172.21.15.139:0/2711113056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6dd8162f60 0x7f6dd806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.108+0000 7f6ddf92b640 1 --2- 172.21.15.139:0/2711113056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dd80b6680 0x7f6dd815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.108+0000 7f6ddf92b640 1 --2- 172.21.15.139:0/2711113056 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6dd80b6100 0x7f6dd81f6590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.108+0000 7f6ddf92b640 1 -- 172.21.15.139:0/2711113056 >> 172.21.15.139:0/2711113056 conn(0x7f6dd80d12a0 msgr2=0x7f6dd80c77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:18.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.108+0000 7f6ddf92b640 1 -- 172.21.15.139:0/2711113056 shutdown_connections 2024-09-21T01:49:18.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.108+0000 7f6ddf92b640 1 -- 172.21.15.139:0/2711113056 wait complete. 2024-09-21T01:49:18.118 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new b95f7195-e3bd-4af7-8074-c13a6e73c387 6 2024-09-21T01:49:18.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.231+0000 7f6fdc569640 1 -- 172.21.15.139:0/3977902001 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6fd409aa30 msgr2=0x7f6fd40ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.231+0000 7f6fdc569640 1 --2- 172.21.15.139:0/3977902001 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6fd409aa30 0x7f6fd40ccad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc005fd0 tx=0x7f6fcc02aa90 comp rx=0 tx=0).stop 2024-09-21T01:49:18.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.231+0000 7f6fdc569640 1 -- 172.21.15.139:0/3977902001 shutdown_connections 2024-09-21T01:49:18.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.231+0000 7f6fdc569640 1 --2- 172.21.15.139:0/3977902001 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6fd409aa30 0x7f6fd40ccad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.231+0000 7f6fdc569640 1 --2- 172.21.15.139:0/3977902001 >> v2:172.21.15.40:3300/0 conn(0x7f6fd40cf520 0x7f6fd40ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.231+0000 7f6fdc569640 1 -- 172.21.15.139:0/3977902001 >> 172.21.15.139:0/3977902001 conn(0x7f6fd4074170 msgr2=0x7f6fd40b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:18.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.231+0000 7f6fdc569640 1 -- 172.21.15.139:0/3977902001 shutdown_connections 2024-09-21T01:49:18.232 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.232+0000 7f6fdc569640 1 -- 172.21.15.139:0/3977902001 wait complete. 2024-09-21T01:49:18.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.233+0000 7f6fdc569640 1 Processor -- start 2024-09-21T01:49:18.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.233+0000 7f6fdc569640 1 -- start start 2024-09-21T01:49:18.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdc569640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6fd409aa30 0x7f6fd415bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdc569640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd415b900 0x7f6fd41f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdc569640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd41f97a0 0x7f6fd40ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdc569640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd40cd010 con 0x7f6fd415b900 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdc569640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd40cdec0 con 0x7f6fd41f97a0 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdc569640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd40cd190 con 0x7f6fd409aa30 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fda305640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6fd409aa30 0x7f6fd415bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdab06640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd41f97a0 0x7f6fd40ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fda305640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6fd409aa30 0x7f6fd415bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:56068/0 (socket says 172.21.15.139:56068) 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdab06640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd41f97a0 0x7f6fd40ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:59448/0 (socket says 172.21.15.139:59448) 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fda305640 1 -- 172.21.15.139:0/2273344501 learned_addr learned my addr 172.21.15.139:0/2273344501 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fd9b04640 1 --2- 172.21.15.139:0/2273344501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd415b900 0x7f6fd41f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdab06640 1 -- 172.21.15.139:0/2273344501 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6fd409aa30 msgr2=0x7f6fd415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdab06640 1 --2- 172.21.15.139:0/2273344501 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6fd409aa30 0x7f6fd415bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdab06640 1 -- 172.21.15.139:0/2273344501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd415b900 msgr2=0x7f6fd41f9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdab06640 1 --2- 172.21.15.139:0/2273344501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd415b900 0x7f6fd41f9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdab06640 1 -- 172.21.15.139:0/2273344501 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd41f66d0 con 0x7f6fd41f97a0 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdab06640 1 --2- 172.21.15.139:0/2273344501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd41f97a0 0x7f6fd40ce0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40cc7c0 tx=0x7f6fcc003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:18.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fc6ffd640 1 -- 172.21.15.139:0/2273344501 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc003e00 con 0x7f6fd41f97a0 2024-09-21T01:49:18.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fc6ffd640 1 -- 172.21.15.139:0/2273344501 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fcc004250 con 0x7f6fd41f97a0 2024-09-21T01:49:18.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fc6ffd640 1 -- 172.21.15.139:0/2273344501 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0046a0 con 0x7f6fd41f97a0 2024-09-21T01:49:18.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdc569640 1 -- 172.21.15.139:0/2273344501 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd41f56b0 con 0x7f6fd41f97a0 2024-09-21T01:49:18.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.235+0000 7f6fdc569640 1 -- 172.21.15.139:0/2273344501 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd41f5c70 con 0x7f6fd41f97a0 2024-09-21T01:49:18.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.236+0000 7f6fc6ffd640 1 -- 172.21.15.139:0/2273344501 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6fcc040420 con 0x7f6fd41f97a0 2024-09-21T01:49:18.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.236+0000 7f6fc6ffd640 1 -- 172.21.15.139:0/2273344501 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f6fcc040d00 con 0x7f6fd41f97a0 2024-09-21T01:49:18.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.236+0000 7f6fdc569640 1 -- 172.21.15.139:0/2273344501 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd41f68a0 con 0x7f6fd41f97a0 2024-09-21T01:49:18.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.238+0000 7f6fc6ffd640 1 -- 172.21.15.139:0/2273344501 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6fcc032030 con 0x7f6fd41f97a0 2024-09-21T01:49:18.309 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.309+0000 7f6fdc569640 1 -- 172.21.15.139:0/2273344501 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b95f7195-e3bd-4af7-8074-c13a6e73c387", "id": 6} v 0) -- 0x7f6fd40cd6c0 con 0x7f6fd41f97a0 2024-09-21T01:49:18.312 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.313+0000 7f6fc6ffd640 1 -- 172.21.15.139:0/2273344501 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b95f7195-e3bd-4af7-8074-c13a6e73c387", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f6fcc040710 con 0x7f6fd41f97a0 2024-09-21T01:49:18.313 INFO:teuthology.orchestra.run.smithi139.stdout:6 2024-09-21T01:49:18.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.313+0000 7f6fdc569640 1 -- 172.21.15.139:0/2273344501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd41f97a0 msgr2=0x7f6fd40ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.313+0000 7f6fdc569640 1 --2- 172.21.15.139:0/2273344501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd41f97a0 0x7f6fd40ce0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40cc7c0 tx=0x7f6fcc003c10 comp rx=0 tx=0).stop 2024-09-21T01:49:18.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.314+0000 7f6fdc569640 1 -- 172.21.15.139:0/2273344501 shutdown_connections 2024-09-21T01:49:18.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.314+0000 7f6fdc569640 1 --2- 172.21.15.139:0/2273344501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6fd41f97a0 0x7f6fd40ce0a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.314+0000 7f6fdc569640 1 --2- 172.21.15.139:0/2273344501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fd415b900 0x7f6fd41f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.314+0000 7f6fdc569640 1 --2- 172.21.15.139:0/2273344501 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f6fd409aa30 0x7f6fd415bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.314+0000 7f6fdc569640 1 -- 172.21.15.139:0/2273344501 >> 172.21.15.139:0/2273344501 conn(0x7f6fd4074170 msgr2=0x7f6fd40af320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:18.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.314+0000 7f6fdc569640 1 -- 172.21.15.139:0/2273344501 shutdown_connections 2024-09-21T01:49:18.314 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.314+0000 7f6fdc569640 1 -- 172.21.15.139:0/2273344501 wait complete. 2024-09-21T01:49:18.324 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 37b2f54f-005a-4a5a-92bd-52c5e8f1ec30 7 2024-09-21T01:49:18.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.437+0000 7f4beafc6640 1 -- 172.21.15.139:0/253802954 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be40cf6f0 msgr2=0x7f4be4074530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.437+0000 7f4beafc6640 1 --2- 172.21.15.139:0/253802954 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be40cf6f0 0x7f4be4074530 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0005fd0 tx=0x7f4bd002a5d0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.437+0000 7f4beafc6640 1 -- 172.21.15.139:0/253802954 shutdown_connections 2024-09-21T01:49:18.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.437+0000 7f4beafc6640 1 --2- 172.21.15.139:0/253802954 >> v2:172.21.15.40:3300/0 conn(0x7f4be4074a70 0x7f4be40cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.437+0000 7f4beafc6640 1 --2- 172.21.15.139:0/253802954 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be40cf6f0 0x7f4be4074530 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.437+0000 7f4beafc6640 1 -- 172.21.15.139:0/253802954 >> 172.21.15.139:0/253802954 conn(0x7f4be40cdc60 msgr2=0x7f4be40ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:18.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.437+0000 7f4beafc6640 1 -- 172.21.15.139:0/253802954 shutdown_connections 2024-09-21T01:49:18.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.437+0000 7f4beafc6640 1 -- 172.21.15.139:0/253802954 wait complete. 2024-09-21T01:49:18.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.439+0000 7f4beafc6640 1 Processor -- start 2024-09-21T01:49:18.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.439+0000 7f4beafc6640 1 -- start start 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4beafc6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be4074a70 0x7f4be4150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4beafc6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4be40cf6f0 0x7f4be41558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4beafc6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be415cca0 0x7f4be4155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4beafc6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40cc100 con 0x7f4be40cf6f0 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4beafc6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40cbf80 con 0x7f4be415cca0 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4beafc6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f4be406cde0 con 0x7f4be4074a70 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4be8d62640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be4074a70 0x7f4be4150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4be9563640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be415cca0 0x7f4be4155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4be8d62640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be4074a70 0x7f4be4150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.139:56088/0 (socket says 172.21.15.139:56088) 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4be9563640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be415cca0 0x7f4be4155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:59458/0 (socket says 172.21.15.139:59458) 2024-09-21T01:49:18.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4be8d62640 1 -- 172.21.15.139:0/687217430 learned_addr learned my addr 172.21.15.139:0/687217430 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.440+0000 7f4be3fff640 1 --2- 172.21.15.139:0/687217430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4be40cf6f0 0x7f4be41558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be9563640 1 -- 172.21.15.139:0/687217430 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be4074a70 msgr2=0x7f4be4150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be9563640 1 --2- 172.21.15.139:0/687217430 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be4074a70 0x7f4be4150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be9563640 1 -- 172.21.15.139:0/687217430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4be40cf6f0 msgr2=0x7f4be41558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be9563640 1 --2- 172.21.15.139:0/687217430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4be40cf6f0 0x7f4be41558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be9563640 1 -- 172.21.15.139:0/687217430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be41f3b90 con 0x7f4be415cca0 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be8d62640 1 --2- 172.21.15.139:0/687217430 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be4074a70 0x7f4be4150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be9563640 1 --2- 172.21.15.139:0/687217430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be415cca0 0x7f4be4155de0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc005fd0 tx=0x7f4bdc00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be17fa640 1 -- 172.21.15.139:0/687217430 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00cd80 con 0x7f4be415cca0 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be17fa640 1 -- 172.21.15.139:0/687217430 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bdc004c10 con 0x7f4be415cca0 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be17fa640 1 -- 172.21.15.139:0/687217430 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc005020 con 0x7f4be415cca0 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4beafc6640 1 -- 172.21.15.139:0/687217430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be41f3e70 con 0x7f4be415cca0 2024-09-21T01:49:18.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4beafc6640 1 -- 172.21.15.139:0/687217430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41f4430 con 0x7f4be415cca0 2024-09-21T01:49:18.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be17fa640 1 -- 172.21.15.139:0/687217430 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4bdc005550 con 0x7f4be415cca0 2024-09-21T01:49:18.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.441+0000 7f4be17fa640 1 -- 172.21.15.139:0/687217430 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f4bdc005840 con 0x7f4be415cca0 2024-09-21T01:49:18.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.442+0000 7f4beafc6640 1 -- 172.21.15.139:0/687217430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be40cea30 con 0x7f4be415cca0 2024-09-21T01:49:18.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.446+0000 7f4be17fa640 1 -- 172.21.15.139:0/687217430 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4be40cea30 con 0x7f4be415cca0 2024-09-21T01:49:18.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.516+0000 7f4beafc6640 1 -- 172.21.15.139:0/687217430 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37b2f54f-005a-4a5a-92bd-52c5e8f1ec30", "id": 7} v 0) -- 0x7f4be40cb830 con 0x7f4be415cca0 2024-09-21T01:49:18.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.521+0000 7f4be17fa640 1 -- 172.21.15.139:0/687217430 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37b2f54f-005a-4a5a-92bd-52c5e8f1ec30", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f4bdc018470 con 0x7f4be415cca0 2024-09-21T01:49:18.521 INFO:teuthology.orchestra.run.smithi139.stdout:7 2024-09-21T01:49:18.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.522+0000 7f4beafc6640 1 -- 172.21.15.139:0/687217430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be415cca0 msgr2=0x7f4be4155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.522+0000 7f4beafc6640 1 --2- 172.21.15.139:0/687217430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be415cca0 0x7f4be4155de0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc005fd0 tx=0x7f4bdc00ee40 comp rx=0 tx=0).stop 2024-09-21T01:49:18.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.522+0000 7f4beafc6640 1 -- 172.21.15.139:0/687217430 shutdown_connections 2024-09-21T01:49:18.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.522+0000 7f4beafc6640 1 --2- 172.21.15.139:0/687217430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4be415cca0 0x7f4be4155de0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.522+0000 7f4beafc6640 1 --2- 172.21.15.139:0/687217430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4be40cf6f0 0x7f4be41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.522+0000 7f4beafc6640 1 --2- 172.21.15.139:0/687217430 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4be4074a70 0x7f4be4150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.522+0000 7f4beafc6640 1 -- 172.21.15.139:0/687217430 >> 172.21.15.139:0/687217430 conn(0x7f4be40cdc60 msgr2=0x7f4be415f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:18.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.522+0000 7f4beafc6640 1 -- 172.21.15.139:0/687217430 shutdown_connections 2024-09-21T01:49:18.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:18.522+0000 7f4beafc6640 1 -- 172.21.15.139:0/687217430 wait complete. 2024-09-21T01:49:18.533 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T01:49:18.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T01:49:18.535 INFO:tasks.ceph.osd.0:Started 2024-09-21T01:49:18.536 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T01:49:18.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T01:49:18.538 INFO:tasks.ceph.osd.1:Started 2024-09-21T01:49:18.538 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T01:49:18.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T01:49:18.540 INFO:tasks.ceph.osd.2:Started 2024-09-21T01:49:18.540 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T01:49:18.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T01:49:18.542 INFO:tasks.ceph.osd.3:Started 2024-09-21T01:49:18.542 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T01:49:18.542 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T01:49:18.544 INFO:tasks.ceph.osd.4:Started 2024-09-21T01:49:18.545 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T01:49:18.545 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T01:49:18.546 INFO:tasks.ceph.osd.5:Started 2024-09-21T01:49:18.547 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T01:49:18.547 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T01:49:18.549 INFO:tasks.ceph.osd.6:Started 2024-09-21T01:49:18.549 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T01:49:18.549 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T01:49:18.551 INFO:tasks.ceph.osd.7:Started 2024-09-21T01:49:18.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.696+0000 7f4af51b6640 1 -- 172.21.15.40:0/3492358362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4af006e170 msgr2=0x7f4af00b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.696+0000 7f4af51b6640 1 --2- 172.21.15.40:0/3492358362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4af006e170 0x7f4af00b3540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4af008d9b0 tx=0x7f4ae002a4d0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.696+0000 7f4af51b6640 1 -- 172.21.15.40:0/3492358362 shutdown_connections 2024-09-21T01:49:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.696+0000 7f4af51b6640 1 --2- 172.21.15.40:0/3492358362 >> v2:172.21.15.139:3300/0 conn(0x7f4af006f4b0 0x7f4af00d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.696+0000 7f4af51b6640 1 --2- 172.21.15.40:0/3492358362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4af006e170 0x7f4af00b3540 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.696+0000 7f4af51b6640 1 -- 172.21.15.40:0/3492358362 >> 172.21.15.40:0/3492358362 conn(0x7f4af008bfc0 msgr2=0x7f4af009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:18.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.696+0000 7f4af51b6640 1 -- 172.21.15.40:0/3492358362 shutdown_connections 2024-09-21T01:49:18.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.696+0000 7f4af51b6640 1 -- 172.21.15.40:0/3492358362 wait complete. 2024-09-21T01:49:18.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.698+0000 7f4af51b6640 1 Processor -- start 2024-09-21T01:49:18.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.699+0000 7f4af51b6640 1 -- start start 2024-09-21T01:49:18.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4af51b6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4af006f4b0 0x7f4af0150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4af51b6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4af00d3870 0x7f4af00cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4af51b6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af015c8f0 0x7f4af00cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4af51b6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4af00d0ce0 con 0x7f4af006f4b0 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4af51b6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4af00cf4e0 con 0x7f4af015c8f0 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4af51b6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f4af00d0e60 con 0x7f4af00d3870 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aeed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4af006f4b0 0x7f4af0150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aeed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4af006f4b0 0x7f4af0150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38714/0 (socket says 172.21.15.40:38714) 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aeed9d640 1 -- 172.21.15.40:0/2159184543 learned_addr learned my addr 172.21.15.40:0/2159184543 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aee59c640 1 --2- 172.21.15.40:0/2159184543 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4af00d3870 0x7f4af00cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aef59e640 1 --2- 172.21.15.40:0/2159184543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af015c8f0 0x7f4af00cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aee59c640 1 -- 172.21.15.40:0/2159184543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af015c8f0 msgr2=0x7f4af00cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aee59c640 1 --2- 172.21.15.40:0/2159184543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af015c8f0 0x7f4af00cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aee59c640 1 -- 172.21.15.40:0/2159184543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4af006f4b0 msgr2=0x7f4af0150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aee59c640 1 --2- 172.21.15.40:0/2159184543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4af006f4b0 0x7f4af0150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.700+0000 7f4aee59c640 1 -- 172.21.15.40:0/2159184543 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af0150e70 con 0x7f4af00d3870 2024-09-21T01:49:18.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.701+0000 7f4aee59c640 1 --2- 172.21.15.40:0/2159184543 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4af00d3870 0x7f4af00cb5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400e6a0 tx=0x7f4ae400eb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:18.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.701+0000 7f4ad77fe640 1 -- 172.21.15.40:0/2159184543 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400cab0 con 0x7f4af00d3870 2024-09-21T01:49:18.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.701+0000 7f4ad77fe640 1 -- 172.21.15.40:0/2159184543 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ae400cd40 con 0x7f4af00d3870 2024-09-21T01:49:18.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.701+0000 7f4af51b6640 1 -- 172.21.15.40:0/2159184543 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af015b430 con 0x7f4af00d3870 2024-09-21T01:49:18.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.701+0000 7f4af51b6640 1 -- 172.21.15.40:0/2159184543 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af015b9f0 con 0x7f4af00d3870 2024-09-21T01:49:18.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.701+0000 7f4ad77fe640 1 -- 172.21.15.40:0/2159184543 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4010690 con 0x7f4af00d3870 2024-09-21T01:49:18.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.702+0000 7f4ad77fe640 1 -- 172.21.15.40:0/2159184543 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ae4010830 con 0x7f4af00d3870 2024-09-21T01:49:18.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.702+0000 7f4ad77fe640 1 -- 172.21.15.40:0/2159184543 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4ae4018cc0 con 0x7f4af00d3870 2024-09-21T01:49:18.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.702+0000 7f4af51b6640 1 -- 172.21.15.40:0/2159184543 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af00d07c0 con 0x7f4af00d3870 2024-09-21T01:49:18.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.704+0000 7f4ad77fe640 1 -- 172.21.15.40:0/2159184543 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4af00d07c0 con 0x7f4af00d3870 2024-09-21T01:49:18.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.765+0000 7f4af51b6640 1 -- 172.21.15.40:0/2159184543 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4af006e170 con 0x7f4af00d3870 2024-09-21T01:49:18.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.766+0000 7f4ad77fe640 1 -- 172.21.15.40:0/2159184543 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4ae4010d00 con 0x7f4af00d3870 2024-09-21T01:49:18.767 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:18.767 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:18.518417+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:18.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.767+0000 7f4af51b6640 1 -- 172.21.15.40:0/2159184543 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4af00d3870 msgr2=0x7f4af00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:18.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.767+0000 7f4af51b6640 1 --2- 172.21.15.40:0/2159184543 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4af00d3870 0x7f4af00cb5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400e6a0 tx=0x7f4ae400eb60 comp rx=0 tx=0).stop 2024-09-21T01:49:18.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.767+0000 7f4af51b6640 1 -- 172.21.15.40:0/2159184543 shutdown_connections 2024-09-21T01:49:18.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.767+0000 7f4af51b6640 1 --2- 172.21.15.40:0/2159184543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af015c8f0 0x7f4af00cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.767+0000 7f4af51b6640 1 --2- 172.21.15.40:0/2159184543 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4af00d3870 0x7f4af00cb5c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.767+0000 7f4af51b6640 1 --2- 172.21.15.40:0/2159184543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4af006f4b0 0x7f4af0150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.767+0000 7f4af51b6640 1 -- 172.21.15.40:0/2159184543 >> 172.21.15.40:0/2159184543 conn(0x7f4af008bfc0 msgr2=0x7f4af0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.767+0000 7f4af51b6640 1 -- 172.21.15.40:0/2159184543 shutdown_connections 2024-09-21T01:49:18.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:18.767+0000 7f4af51b6640 1 -- 172.21.15.40:0/2159184543 wait complete. 2024-09-21T01:49:18.778 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T01:49:18.778 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T01:49:19.583 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:19.691 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.690+0000 7f371f0a9640 1 -- 172.21.15.40:0/977704050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37180b59c0 msgr2=0x7f371815bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:19.691 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.690+0000 7f371f0a9640 1 --2- 172.21.15.40:0/977704050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37180b59c0 0x7f371815bc70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f371815cd60 tx=0x7f370402a4a0 comp rx=0 tx=0).stop 2024-09-21T01:49:19.691 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.690+0000 7f371f0a9640 1 -- 172.21.15.40:0/977704050 shutdown_connections 2024-09-21T01:49:19.691 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.690+0000 7f371f0a9640 1 --2- 172.21.15.40:0/977704050 >> v2:172.21.15.139:3300/0 conn(0x7f37180d04f0 0x7f371806f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:19.691 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.690+0000 7f371f0a9640 1 --2- 172.21.15.40:0/977704050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37180b59c0 0x7f371815bc70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:19.691 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.690+0000 7f371f0a9640 1 -- 172.21.15.40:0/977704050 >> 172.21.15.40:0/977704050 conn(0x7f37180d0e90 msgr2=0x7f37180d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:19.691 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.690+0000 7f371f0a9640 1 -- 172.21.15.40:0/977704050 shutdown_connections 2024-09-21T01:49:19.691 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.690+0000 7f371f0a9640 1 -- 172.21.15.40:0/977704050 wait complete. 2024-09-21T01:49:19.692 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.692+0000 7f371f0a9640 1 Processor -- start 2024-09-21T01:49:19.692 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.692+0000 7f371f0a9640 1 -- start start 2024-09-21T01:49:19.695 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.693+0000 7f371f0a9640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f371806def0 0x7f3718149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:19.695 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.693+0000 7f371f0a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37180d04f0 0x7f37181e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:19.695 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.693+0000 7f371f0a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37181e3c70 0x7f37181e4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:19.695 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.693+0000 7f371f0a9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f37180702b0 con 0x7f37181e3c70 2024-09-21T01:49:19.695 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.693+0000 7f371f0a9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3718070130 con 0x7f37180d04f0 2024-09-21T01:49:19.695 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.693+0000 7f371f0a9640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f3718070430 con 0x7f371806def0 2024-09-21T01:49:19.695 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.693+0000 7f371d646640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37181e3c70 0x7f37181e4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:19.695 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.693+0000 7f371d646640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37181e3c70 0x7f37181e4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38732/0 (socket says 172.21.15.40:38732) 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.693+0000 7f371d646640 1 -- 172.21.15.40:0/955249929 learned_addr learned my addr 172.21.15.40:0/955249929 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f371ce45640 1 --2- 172.21.15.40:0/955249929 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f371806def0 0x7f3718149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f3717fff640 1 --2- 172.21.15.40:0/955249929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37180d04f0 0x7f37181e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f371d646640 1 -- 172.21.15.40:0/955249929 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f371806def0 msgr2=0x7f3718149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f371d646640 1 --2- 172.21.15.40:0/955249929 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f371806def0 0x7f3718149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f371d646640 1 -- 172.21.15.40:0/955249929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37180d04f0 msgr2=0x7f37181e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f371d646640 1 --2- 172.21.15.40:0/955249929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37180d04f0 0x7f37181e8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f371d646640 1 -- 172.21.15.40:0/955249929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37181e45c0 con 0x7f37181e3c70 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f371d646640 1 --2- 172.21.15.40:0/955249929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37181e3c70 0x7f37181e4080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f371000caa0 tx=0x7f371000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f37157fa640 1 -- 172.21.15.40:0/955249929 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371000adf0 con 0x7f37181e3c70 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f37157fa640 1 -- 172.21.15.40:0/955249929 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f371000f540 con 0x7f37181e3c70 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f37157fa640 1 -- 172.21.15.40:0/955249929 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371000f990 con 0x7f37181e3c70 2024-09-21T01:49:19.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f371f0a9640 1 -- 172.21.15.40:0/955249929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37181f40f0 con 0x7f37181e3c70 2024-09-21T01:49:19.697 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.694+0000 7f371f0a9640 1 -- 172.21.15.40:0/955249929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37181e8b50 con 0x7f37181e3c70 2024-09-21T01:49:19.697 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.695+0000 7f37157fa640 1 -- 172.21.15.40:0/955249929 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f371000fb30 con 0x7f37181e3c70 2024-09-21T01:49:19.697 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.695+0000 7f37157fa640 1 -- 172.21.15.40:0/955249929 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3710052f00 con 0x7f37181e3c70 2024-09-21T01:49:19.697 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.696+0000 7f371f0a9640 1 -- 172.21.15.40:0/955249929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37180708e0 con 0x7f37181e3c70 2024-09-21T01:49:19.698 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.698+0000 7f37157fa640 1 -- 172.21.15.40:0/955249929 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f37181e45c0 con 0x7f37181e3c70 2024-09-21T01:49:19.760 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.760+0000 7f371f0a9640 1 -- 172.21.15.40:0/955249929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37181e9050 con 0x7f37181e3c70 2024-09-21T01:49:19.761 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.760+0000 7f37157fa640 1 -- 172.21.15.40:0/955249929 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f371000fe20 con 0x7f37181e3c70 2024-09-21T01:49:19.761 INFO:teuthology.misc.health.smithi040.stdout: 2024-09-21T01:49:19.761 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:18.518417+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:19.762 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.761+0000 7f371f0a9640 1 -- 172.21.15.40:0/955249929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37181e3c70 msgr2=0x7f37181e4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:19.762 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.761+0000 7f371f0a9640 1 --2- 172.21.15.40:0/955249929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37181e3c70 0x7f37181e4080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f371000caa0 tx=0x7f371000cf60 comp rx=0 tx=0).stop 2024-09-21T01:49:19.762 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.762+0000 7f371f0a9640 1 -- 172.21.15.40:0/955249929 shutdown_connections 2024-09-21T01:49:19.762 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.762+0000 7f371f0a9640 1 --2- 172.21.15.40:0/955249929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37181e3c70 0x7f37181e4080 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:19.762 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.762+0000 7f371f0a9640 1 --2- 172.21.15.40:0/955249929 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f37180d04f0 0x7f37181e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:19.763 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.762+0000 7f371f0a9640 1 --2- 172.21.15.40:0/955249929 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f371806def0 0x7f3718149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:19.763 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.762+0000 7f371f0a9640 1 -- 172.21.15.40:0/955249929 >> 172.21.15.40:0/955249929 conn(0x7f37180d0e90 msgr2=0x7f37181523d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:19.763 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.762+0000 7f371f0a9640 1 -- 172.21.15.40:0/955249929 shutdown_connections 2024-09-21T01:49:19.763 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:19.762+0000 7f371f0a9640 1 -- 172.21.15.40:0/955249929 wait complete. 2024-09-21T01:49:19.774 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T01:49:19.774+0000 7f843e4b4640 -1 Falling back to public interface 2024-09-21T01:49:19.775 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T01:49:20.022 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T01:49:20.022+0000 7f7fefe33640 -1 Falling back to public interface 2024-09-21T01:49:20.263 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T01:49:20.263+0000 7f6691ffd640 -1 Falling back to public interface 2024-09-21T01:49:20.287 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T01:49:20.287+0000 7f2a1e210640 -1 Falling back to public interface 2024-09-21T01:49:20.312 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-21T01:49:20.312+0000 7f7ff095e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T01:49:20.313 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-21T01:49:20.313+0000 7f7ff095e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T01:49:20.501 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T01:49:20.501+0000 7fc73a9c5640 -1 Falling back to public interface 2024-09-21T01:49:20.511 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T01:49:20.511+0000 7f4c58b34640 -1 Falling back to public interface 2024-09-21T01:49:20.533 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T01:49:20.533+0000 7fb8d52d8640 -1 Falling back to public interface 2024-09-21T01:49:20.537 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T01:49:20.537+0000 7fdabb619640 -1 Falling back to public interface 2024-09-21T01:49:23.570 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T01:49:23.568+0000 7f7fefe33640 -1 osd.2 0 log_to_monitors true 2024-09-21T01:49:23.582 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T01:49:23.582+0000 7f843e4b4640 -1 osd.1 0 log_to_monitors true 2024-09-21T01:49:24.088 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T01:49:24.088+0000 7fdabb619640 -1 osd.0 0 log_to_monitors true 2024-09-21T01:49:24.248 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T01:49:24.247+0000 7fc73a9c5640 -1 osd.5 0 log_to_monitors true 2024-09-21T01:49:24.327 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T01:49:24.326+0000 7f6691ffd640 -1 osd.6 0 log_to_monitors true 2024-09-21T01:49:24.527 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T01:49:24.526+0000 7f4c58b34640 -1 osd.3 0 log_to_monitors true 2024-09-21T01:49:24.578 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T01:49:24.577+0000 7fb8d52d8640 -1 osd.7 0 log_to_monitors true 2024-09-21T01:49:24.605 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T01:49:24.604+0000 7f2a1e210640 -1 osd.4 0 log_to_monitors true 2024-09-21T01:49:26.162 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T01:49:26.162+0000 7f7febdc1640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T01:49:26.213 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T01:49:26.213+0000 7f7fe3bb7640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:49:26.581 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:26.601 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T01:49:26.601+0000 7f843ac57640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T01:49:26.619 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T01:49:26.619+0000 7f8432238640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:49:26.713 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.712+0000 7f110e630640 1 -- 172.21.15.40:0/1507568150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080b1df0 msgr2=0x7f11080b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:26.713 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.712+0000 7f110e630640 1 --2- 172.21.15.40:0/1507568150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080b1df0 0x7f11080b7930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009830 tx=0x7f10f802a5c0 comp rx=0 tx=0).stop 2024-09-21T01:49:26.713 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.713+0000 7f110e630640 1 -- 172.21.15.40:0/1507568150 shutdown_connections 2024-09-21T01:49:26.714 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.713+0000 7f110e630640 1 --2- 172.21.15.40:0/1507568150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080b1df0 0x7f11080b7930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:26.714 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.713+0000 7f110e630640 1 -- 172.21.15.40:0/1507568150 >> 172.21.15.40:0/1507568150 conn(0x7f11080cefa0 msgr2=0x7f11080cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:26.714 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.713+0000 7f110e630640 1 -- 172.21.15.40:0/1507568150 shutdown_connections 2024-09-21T01:49:26.714 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.713+0000 7f110e630640 1 -- 172.21.15.40:0/1507568150 wait complete. 2024-09-21T01:49:26.715 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.715+0000 7f110e630640 1 Processor -- start 2024-09-21T01:49:26.715 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.715+0000 7f110e630640 1 -- start start 2024-09-21T01:49:26.719 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f110e630640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11080b1df0 0x7f1108151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:26.719 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f110e630640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11080b2200 0x7f11080c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:26.719 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f110e630640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080d1150 0x7f11081521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:26.719 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f110e630640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f11080767f0 con 0x7f11080d1150 2024-09-21T01:49:26.719 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f110e630640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1108076670 con 0x7f11080b1df0 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f110e630640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f11080b7e70 con 0x7f11080b2200 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f110cbcd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080d1150 0x7f11081521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f110cbcd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080d1150 0x7f11081521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49852/0 (socket says 172.21.15.40:49852) 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f110cbcd640 1 -- 172.21.15.40:0/4152575332 learned_addr learned my addr 172.21.15.40:0/4152575332 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f1107fff640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11080b1df0 0x7f1108151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.717+0000 7f11077fe640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11080b2200 0x7f11080c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f110cbcd640 1 -- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11080b2200 msgr2=0x7f11080c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f110cbcd640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11080b2200 0x7f11080c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f110cbcd640 1 -- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11080b1df0 msgr2=0x7f1108151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f110cbcd640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11080b1df0 0x7f1108151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f110cbcd640 1 -- 172.21.15.40:0/4152575332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110815ea70 con 0x7f11080d1150 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f110cbcd640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080d1150 0x7f11081521d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1100002230 tx=0x7f110000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f1104ff9640 1 -- 172.21.15.40:0/4152575332 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100016020 con 0x7f11080d1150 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f1104ff9640 1 -- 172.21.15.40:0/4152575332 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f110000ad20 con 0x7f11080d1150 2024-09-21T01:49:26.720 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f1104ff9640 1 -- 172.21.15.40:0/4152575332 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100012680 con 0x7f11080d1150 2024-09-21T01:49:26.721 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f110815ed50 con 0x7f11080d1150 2024-09-21T01:49:26.721 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.718+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f110815f310 con 0x7f11080d1150 2024-09-21T01:49:26.721 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.720+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1108074300 con 0x7f11080d1150 2024-09-21T01:49:26.722 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.721+0000 7f1104ff9640 1 -- 172.21.15.40:0/4152575332 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f1100019020 con 0x7f11080d1150 2024-09-21T01:49:26.723 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.722+0000 7f1104ff9640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f10f4078b30 0x7f10f407b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:26.723 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.722+0000 7f1104ff9640 1 -- 172.21.15.40:0/4152575332 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f110009a080 con 0x7f11080d1150 2024-09-21T01:49:26.723 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.722+0000 7f1107fff640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f10f4078b30 0x7f10f407b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:26.723 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.723+0000 7f1107fff640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f10f4078b30 0x7f10f407b040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f10f8034000 tx=0x7f10f8004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:26.729 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:26.729+0000 7f1104ff9640 1 -- 172.21.15.40:0/4152575332 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1108074300 con 0x7f11080d1150 2024-09-21T01:49:27.044 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.044+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11080b7930 con 0x7f11080d1150 2024-09-21T01:49:27.045 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.044+0000 7f1104ff9640 1 -- 172.21.15.40:0/4152575332 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f1100020030 con 0x7f11080d1150 2024-09-21T01:49:27.045 INFO:teuthology.misc.health.smithi040.stdout: 2024-09-21T01:49:27.045 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":13,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:25.939650+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f10f4078b30 msgr2=0x7f10f407b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f10f4078b30 0x7f10f407b040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f10f8034000 tx=0x7f10f8004730 comp rx=0 tx=0).stop 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080d1150 msgr2=0x7f11081521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080d1150 0x7f11081521d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1100002230 tx=0x7f110000cf70 comp rx=0 tx=0).stop 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 shutdown_connections 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f10f4078b30 0x7f10f407b040 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11080d1150 0x7f11081521d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f11080b2200 0x7f11080c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 --2- 172.21.15.40:0/4152575332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f11080b1df0 0x7f1108151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 >> 172.21.15.40:0/4152575332 conn(0x7f11080cefa0 msgr2=0x7f1108072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 shutdown_connections 2024-09-21T01:49:27.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:27.048+0000 7f110e630640 1 -- 172.21.15.40:0/4152575332 wait complete. 2024-09-21T01:49:27.063 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T01:49:27.304 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T01:49:27.304+0000 7fdab771a640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T01:49:27.326 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T01:49:27.326+0000 7fdaaecfb640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:49:27.340 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T01:49:27.340+0000 7f4c552d7640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T01:49:27.361 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T01:49:27.361+0000 7f4c4c8b8640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:49:28.067 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T01:49:28.066+0000 7fc736953640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T01:49:28.084 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T01:49:28.083+0000 7fc72e749640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:49:28.101 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T01:49:28.100+0000 7f668df8b640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T01:49:28.107 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T01:49:28.106+0000 7f2a1a312640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T01:49:28.111 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T01:49:28.110+0000 7f6685d81640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:49:28.118 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T01:49:28.118+0000 7fb8d1266640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T01:49:28.125 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T01:49:28.124+0000 7f2a118f3640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:49:28.137 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T01:49:28.136+0000 7fb8c905c640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:49:33.870 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:33.993 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.992+0000 7f38a10e6640 1 -- 172.21.15.40:0/2804812638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 msgr2=0x7f389c0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:33.993 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.992+0000 7f38a10e6640 1 --2- 172.21.15.40:0/2804812638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 0x7f389c0b1710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f389c0d1060 tx=0x7f389402a820 comp rx=0 tx=0).stop 2024-09-21T01:49:33.993 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.992+0000 7f38a10e6640 1 -- 172.21.15.40:0/2804812638 shutdown_connections 2024-09-21T01:49:33.993 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.992+0000 7f38a10e6640 1 --2- 172.21.15.40:0/2804812638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 0x7f389c0b1710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:33.993 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.992+0000 7f38a10e6640 1 --2- 172.21.15.40:0/2804812638 >> v2:172.21.15.139:3300/0 conn(0x7f389c162950 0x7f389c162d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:33.993 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.992+0000 7f38a10e6640 1 -- 172.21.15.40:0/2804812638 >> 172.21.15.40:0/2804812638 conn(0x7f389c0d4660 msgr2=0x7f389c0d4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:33.993 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.992+0000 7f38a10e6640 1 -- 172.21.15.40:0/2804812638 shutdown_connections 2024-09-21T01:49:33.993 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.992+0000 7f38a10e6640 1 -- 172.21.15.40:0/2804812638 wait complete. 2024-09-21T01:49:33.994 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.994+0000 7f38a10e6640 1 Processor -- start 2024-09-21T01:49:33.995 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.994+0000 7f38a10e6640 1 -- start start 2024-09-21T01:49:33.998 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.995+0000 7f38a10e6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f389c0b35d0 0x7f389c0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:33.998 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.995+0000 7f38a10e6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f389c162950 0x7f389c1f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:33.998 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.995+0000 7f38a10e6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 0x7f389c1f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:33.998 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.995+0000 7f38a10e6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f389c0b1fe0 con 0x7f389c1632a0 2024-09-21T01:49:33.998 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.995+0000 7f38a10e6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f389c0b1e60 con 0x7f389c162950 2024-09-21T01:49:33.998 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.995+0000 7f38a10e6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f389c0b2160 con 0x7f389c0b35d0 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 0x7f389c1f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 0x7f389c1f95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41266/0 (socket says 172.21.15.40:41266) 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389b59e640 1 -- 172.21.15.40:0/3607587813 learned_addr learned my addr 172.21.15.40:0/3607587813 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389a59c640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f389c162950 0x7f389c1f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389ad9d640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f389c0b35d0 0x7f389c0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389b59e640 1 -- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f389c0b35d0 msgr2=0x7f389c0caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389b59e640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f389c0b35d0 0x7f389c0caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389b59e640 1 -- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f389c162950 msgr2=0x7f389c1f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389b59e640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f389c162950 0x7f389c1f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389b59e640 1 -- 172.21.15.40:0/3607587813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c0c8280 con 0x7f389c1632a0 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389ad9d640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f389c0b35d0 0x7f389c0caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:33.999 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f389b59e640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 0x7f389c1f95a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3894009ca0 tx=0x7f3894032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:34.000 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f38837fe640 1 -- 172.21.15.40:0/3607587813 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389403f020 con 0x7f389c1632a0 2024-09-21T01:49:34.000 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f38837fe640 1 -- 172.21.15.40:0/3607587813 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3894004040 con 0x7f389c1632a0 2024-09-21T01:49:34.000 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c0c8520 con 0x7f389c1632a0 2024-09-21T01:49:34.000 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f38837fe640 1 -- 172.21.15.40:0/3607587813 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894037040 con 0x7f389c1632a0 2024-09-21T01:49:34.000 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.996+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c0c8800 con 0x7f389c1632a0 2024-09-21T01:49:34.000 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.997+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f389c0b4a50 con 0x7f389c1632a0 2024-09-21T01:49:34.001 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.998+0000 7f38837fe640 1 -- 172.21.15.40:0/3607587813 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3894042020 con 0x7f389c1632a0 2024-09-21T01:49:34.001 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.999+0000 7f38837fe640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3888078b90 0x7f388807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:34.001 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.999+0000 7f38837fe640 1 -- 172.21.15.40:0/3607587813 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f38940baf00 con 0x7f389c1632a0 2024-09-21T01:49:34.001 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:33.999+0000 7f389ad9d640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3888078b90 0x7f388807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:34.001 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.000+0000 7f389ad9d640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3888078b90 0x7f388807b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f388c001610 tx=0x7f388c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:34.004 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.004+0000 7f38837fe640 1 -- 172.21.15.40:0/3607587813 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3894049070 con 0x7f389c1632a0 2024-09-21T01:49:34.193 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.192+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f389c0b1a70 con 0x7f389c1632a0 2024-09-21T01:49:34.194 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.193+0000 7f38837fe640 1 -- 172.21.15.40:0/3607587813 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7f389c0b1a70 con 0x7f389c1632a0 2024-09-21T01:49:34.194 INFO:teuthology.misc.health.smithi040.stdout: 2024-09-21T01:49:34.194 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":17,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:30.259125+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:34.196 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3888078b90 msgr2=0x7f388807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:34.196 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3888078b90 0x7f388807b0a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f388c001610 tx=0x7f388c009040 comp rx=0 tx=0).stop 2024-09-21T01:49:34.196 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 msgr2=0x7f389c1f95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:34.196 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 0x7f389c1f95a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3894009ca0 tx=0x7f3894032c90 comp rx=0 tx=0).stop 2024-09-21T01:49:34.196 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 shutdown_connections 2024-09-21T01:49:34.197 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3888078b90 0x7f388807b0a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.197 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f389c1632a0 0x7f389c1f95a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.197 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f389c162950 0x7f389c1f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.197 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 --2- 172.21.15.40:0/3607587813 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f389c0b35d0 0x7f389c0caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.197 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 >> 172.21.15.40:0/3607587813 conn(0x7f389c0d4660 msgr2=0x7f389c0d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:34.197 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 shutdown_connections 2024-09-21T01:49:34.197 INFO:teuthology.misc.health.smithi040.stderr:2024-09-21T01:49:34.195+0000 7f38a10e6640 1 -- 172.21.15.40:0/3607587813 wait complete. 2024-09-21T01:49:34.206 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T01:49:34.206 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T01:49:34.206 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T01:49:34.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T01:49:34.209 INFO:tasks.ceph.mds.a:Started 2024-09-21T01:49:34.209 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T01:49:34.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T01:49:34.211 INFO:tasks.ceph.mds.c:Started 2024-09-21T01:49:34.211 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T01:49:34.211 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T01:49:34.214 INFO:tasks.ceph.mds.b:Started 2024-09-21T01:49:34.214 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T01:49:34.214 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T01:49:34.216 INFO:tasks.ceph.mds.d:Started 2024-09-21T01:49:34.216 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-21T01:49:34.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:49:34.299 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-09-21T01:49:34.299 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-09-21T01:49:34.313 INFO:tasks.ceph.mds.d.smithi139.stdout:starting mds.d at 2024-09-21T01:49:34.313 INFO:tasks.ceph.mds.b.smithi139.stdout:starting mds.b at 2024-09-21T01:49:34.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.343+0000 7f942725c640 1 -- 172.21.15.40:0/3787337504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 msgr2=0x7f94200d1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:34.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.343+0000 7f942725c640 1 --2- 172.21.15.40:0/3787337504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 0x7f94200d1220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f942008d800 tx=0x7f941802a9e0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.343+0000 7f942725c640 1 -- 172.21.15.40:0/3787337504 shutdown_connections 2024-09-21T01:49:34.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.343+0000 7f942725c640 1 --2- 172.21.15.40:0/3787337504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 0x7f94200d1220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.343+0000 7f942725c640 1 --2- 172.21.15.40:0/3787337504 >> v2:172.21.15.139:3300/0 conn(0x7f942006e3c0 0x7f94200cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.343+0000 7f942725c640 1 -- 172.21.15.40:0/3787337504 >> 172.21.15.40:0/3787337504 conn(0x7f942008bfc0 msgr2=0x7f942009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:34.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.343+0000 7f942725c640 1 -- 172.21.15.40:0/3787337504 shutdown_connections 2024-09-21T01:49:34.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.343+0000 7f942725c640 1 -- 172.21.15.40:0/3787337504 wait complete. 2024-09-21T01:49:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.345+0000 7f942725c640 1 Processor -- start 2024-09-21T01:49:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.345+0000 7f942725c640 1 -- start start 2024-09-21T01:49:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f942725c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f942006e3c0 0x7f942009eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f942725c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94200b3a60 0x7f94200b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f942725c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 0x7f94200b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f942725c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f94200d2c10 con 0x7f94200d0e10 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f942725c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f94200d2a90 con 0x7f94200b3a60 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f942725c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f94200d2d90 con 0x7f942006e3c0 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f94257f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 0x7f94200b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f94257f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 0x7f94200b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41308/0 (socket says 172.21.15.40:41308) 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f94257f9640 1 -- 172.21.15.40:0/3660250543 learned_addr learned my addr 172.21.15.40:0/3660250543 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f941ffff640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94200b3a60 0x7f94200b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f9424ff8640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f942006e3c0 0x7f942009eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f94257f9640 1 -- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f942006e3c0 msgr2=0x7f942009eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f94257f9640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f942006e3c0 0x7f942009eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f94257f9640 1 -- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94200b3a60 msgr2=0x7f94200b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f94257f9640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94200b3a60 0x7f94200b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f94257f9640 1 -- 172.21.15.40:0/3660250543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94201f5760 con 0x7f94200d0e10 2024-09-21T01:49:34.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f94257f9640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 0x7f94200b6670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f941802afd0 tx=0x7f9418003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:34.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f941d7fa640 1 -- 172.21.15.40:0/3660250543 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418033050 con 0x7f94200d0e10 2024-09-21T01:49:34.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f941d7fa640 1 -- 172.21.15.40:0/3660250543 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9418004450 con 0x7f94200d0e10 2024-09-21T01:49:34.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.347+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94201f5a40 con 0x7f94200d0e10 2024-09-21T01:49:34.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.348+0000 7f941d7fa640 1 -- 172.21.15.40:0/3660250543 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418038450 con 0x7f94200d0e10 2024-09-21T01:49:34.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.348+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94201f6000 con 0x7f94200d0e10 2024-09-21T01:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.349+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942009f4c0 con 0x7f94200d0e10 2024-09-21T01:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.349+0000 7f941d7fa640 1 -- 172.21.15.40:0/3660250543 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9418036070 con 0x7f94200d0e10 2024-09-21T01:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.350+0000 7f941d7fa640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9404078b90 0x7f940407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.350+0000 7f941d7fa640 1 -- 172.21.15.40:0/3660250543 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f94180bbd40 con 0x7f94200d0e10 2024-09-21T01:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.350+0000 7f9424ff8640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9404078b90 0x7f940407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.351+0000 7f9424ff8640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9404078b90 0x7f940407b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9414006fd0 tx=0x7f9414008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:34.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.355+0000 7f941d7fa640 1 -- 172.21.15.40:0/3660250543 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f94180844d0 con 0x7f94200d0e10 2024-09-21T01:49:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.579+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94200d3280 con 0x7f94200d0e10 2024-09-21T01:49:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.580+0000 7f941d7fa640 1 -- 172.21.15.40:0/3660250543 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f9418083dd0 con 0x7f94200d0e10 2024-09-21T01:49:34.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:34.581 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"btime":"2024-09-21T01:49:34:305036+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T01:49:34.581 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2024-09-21T01:49:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9404078b90 msgr2=0x7f940407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9404078b90 0x7f940407b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9414006fd0 tx=0x7f9414008040 comp rx=0 tx=0).stop 2024-09-21T01:49:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 msgr2=0x7f94200b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 0x7f94200b6670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f941802afd0 tx=0x7f9418003f10 comp rx=0 tx=0).stop 2024-09-21T01:49:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 shutdown_connections 2024-09-21T01:49:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9404078b90 0x7f940407b0a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94200d0e10 0x7f94200b6670 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94200b3a60 0x7f94200b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 --2- 172.21.15.40:0/3660250543 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f942006e3c0 0x7f942009eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:34.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 >> 172.21.15.40:0/3660250543 conn(0x7f942008bfc0 msgr2=0x7f94200d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:34.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 shutdown_connections 2024-09-21T01:49:34.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:34.582+0000 7f942725c640 1 -- 172.21.15.40:0/3660250543 wait complete. 2024-09-21T01:49:36.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:49:36.196 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:49:36.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:49:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.725+0000 7fa377cbd640 1 -- 172.21.15.40:0/4241091892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c004d40 msgr2=0x7fa35c005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.725+0000 7fa377cbd640 1 --2- 172.21.15.40:0/4241091892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c004d40 0x7fa35c005170 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa368005fd0 tx=0x7fa35c005830 comp rx=0 tx=0).stop 2024-09-21T01:49:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.725+0000 7fa37625a640 1 -- 172.21.15.40:0/4241091892 reap_dead start 2024-09-21T01:49:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.725+0000 7fa377cbd640 1 -- 172.21.15.40:0/4241091892 shutdown_connections 2024-09-21T01:49:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.725+0000 7fa377cbd640 1 -- 172.21.15.40:0/4241091892 >> 172.21.15.40:0/4241091892 conn(0x7fa370072ae0 msgr2=0x7fa370072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.725+0000 7fa377cbd640 1 -- 172.21.15.40:0/4241091892 shutdown_connections 2024-09-21T01:49:36.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.725+0000 7fa377cbd640 1 -- 172.21.15.40:0/4241091892 wait complete. 2024-09-21T01:49:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.727+0000 7fa377cbd640 1 Processor -- start 2024-09-21T01:49:36.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.727+0000 7fa377cbd640 1 -- start start 2024-09-21T01:49:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa377cbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c004d40 0x7fa370159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa377cbd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa3701598a0 0x7fa3701534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa377cbd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa370143160 0x7fa370143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa377cbd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa370165640 con 0x7fa35c004d40 2024-09-21T01:49:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa377cbd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa3701654c0 con 0x7fa370143160 2024-09-21T01:49:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa377cbd640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fa3701657c0 con 0x7fa3701598a0 2024-09-21T01:49:36.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa375a59640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c004d40 0x7fa370159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa375a59640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c004d40 0x7fa370159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41324/0 (socket says 172.21.15.40:41324) 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa375a59640 1 -- 172.21.15.40:0/3201858988 learned_addr learned my addr 172.21.15.40:0/3201858988 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa375258640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa3701598a0 0x7fa3701534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa37625a640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa370143160 0x7fa370143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa375a59640 1 -- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa3701598a0 msgr2=0x7fa3701534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa375a59640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa3701598a0 0x7fa3701534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa375a59640 1 -- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa370143160 msgr2=0x7fa370143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa375a59640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa370143160 0x7fa370143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.728+0000 7fa375a59640 1 -- 172.21.15.40:0/3201858988 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa370158800 con 0x7fa35c004d40 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.729+0000 7fa375a59640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c004d40 0x7fa370159fd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0066e0 tx=0x7fa36c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.729+0000 7fa3627fc640 1 -- 172.21.15.40:0/3201858988 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00f760 con 0x7fa35c004d40 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.729+0000 7fa3627fc640 1 -- 172.21.15.40:0/3201858988 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa36c016020 con 0x7fa35c004d40 2024-09-21T01:49:36.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.729+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa370158ae0 con 0x7fa35c004d40 2024-09-21T01:49:36.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.729+0000 7fa3627fc640 1 -- 172.21.15.40:0/3201858988 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c00fbc0 con 0x7fa35c004d40 2024-09-21T01:49:36.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.729+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3701590a0 con 0x7fa35c004d40 2024-09-21T01:49:36.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.730+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3700b1950 con 0x7fa35c004d40 2024-09-21T01:49:36.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.731+0000 7fa3627fc640 1 -- 172.21.15.40:0/3201858988 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa36c011430 con 0x7fa35c004d40 2024-09-21T01:49:36.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.731+0000 7fa3627fc640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa354078b90 0x7fa35407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:36.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.731+0000 7fa3627fc640 1 -- 172.21.15.40:0/3201858988 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa36c09b530 con 0x7fa35c004d40 2024-09-21T01:49:36.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.732+0000 7fa375258640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa354078b90 0x7fa35407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:36.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.732+0000 7fa375258640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa354078b90 0x7fa35407b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3700b6920 tx=0x7fa364006b10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:36.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.736+0000 7fa3627fc640 1 -- 172.21.15.40:0/3201858988 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa36c020020 con 0x7fa35c004d40 2024-09-21T01:49:36.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.963+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa370157300 con 0x7fa35c004d40 2024-09-21T01:49:36.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.964+0000 7fa3627fc640 1 -- 172.21.15.40:0/3201858988 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7fa36c0636a0 con 0x7fa35c004d40 2024-09-21T01:49:36.965 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:36.965 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"btime":"2024-09-21T01:49:35:308410+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1396929132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1396929132},{"type":"v1","addr":"172.21.15.40:6835","nonce":1396929132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/4017969431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4017969431},{"type":"v1","addr":"172.21.15.139:6836","nonce":4017969431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4410,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/1192218063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":1192218063},{"type":"v1","addr":"172.21.15.139:6837","nonce":1192218063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T01:49:36.965 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2024-09-21T01:49:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa354078b90 msgr2=0x7fa35407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa354078b90 0x7fa35407b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3700b6920 tx=0x7fa364006b10 comp rx=0 tx=0).stop 2024-09-21T01:49:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c004d40 msgr2=0x7fa370159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c004d40 0x7fa370159fd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0066e0 tx=0x7fa36c0039c0 comp rx=0 tx=0).stop 2024-09-21T01:49:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 shutdown_connections 2024-09-21T01:49:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa354078b90 0x7fa35407b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa370143160 0x7fa370143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa3701598a0 0x7fa3701534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 --2- 172.21.15.40:0/3201858988 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c004d40 0x7fa370159fd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 >> 172.21.15.40:0/3201858988 conn(0x7fa370072ae0 msgr2=0x7fa370071090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 shutdown_connections 2024-09-21T01:49:36.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:36.966+0000 7fa377cbd640 1 -- 172.21.15.40:0/3201858988 wait complete. 2024-09-21T01:49:36.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.093+0000 7f8070ca9640 1 -- 172.21.15.40:0/534559125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0cf5d0 msgr2=0x7f806c0cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.093+0000 7f8070ca9640 1 --2- 172.21.15.40:0/534559125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0cf5d0 0x7f806c0cf9e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f806c0d5690 tx=0x7f806402a560 comp rx=0 tx=0).stop 2024-09-21T01:49:37.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.093+0000 7f8070ca9640 1 -- 172.21.15.40:0/534559125 shutdown_connections 2024-09-21T01:49:37.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.093+0000 7f8070ca9640 1 --2- 172.21.15.40:0/534559125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0cf5d0 0x7f806c0cf9e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.093+0000 7f8070ca9640 1 --2- 172.21.15.40:0/534559125 >> v2:172.21.15.139:3300/0 conn(0x7f806c0d1a80 0x7f806c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.093+0000 7f8070ca9640 1 -- 172.21.15.40:0/534559125 >> 172.21.15.40:0/534559125 conn(0x7f806c08bfc0 msgr2=0x7f806c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:37.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.093+0000 7f8070ca9640 1 -- 172.21.15.40:0/534559125 shutdown_connections 2024-09-21T01:49:37.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.093+0000 7f8070ca9640 1 -- 172.21.15.40:0/534559125 wait complete. 2024-09-21T01:49:37.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.095+0000 7f8070ca9640 1 Processor -- start 2024-09-21T01:49:37.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.095+0000 7f8070ca9640 1 -- start start 2024-09-21T01:49:37.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.096+0000 7f8070ca9640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f806c0cf5d0 0x7f806c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.096+0000 7f8070ca9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f806c0d1a80 0x7f806c0b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.096+0000 7f8070ca9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0d2ed0 0x7f806c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.096+0000 7f8070ca9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f806c162bb0 con 0x7f806c0d2ed0 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.096+0000 7f8070ca9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f806c162a30 con 0x7f806c0d1a80 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.096+0000 7f8070ca9640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f806c162d30 con 0x7f806c0cf5d0 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0d2ed0 0x7f806c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0d2ed0 0x7f806c0cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41352/0 (socket says 172.21.15.40:41352) 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806ad9d640 1 -- 172.21.15.40:0/643054382 learned_addr learned my addr 172.21.15.40:0/643054382 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806a59c640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f806c0cf5d0 0x7f806c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f8069d9b640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f806c0d1a80 0x7f806c0b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806ad9d640 1 -- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f806c0cf5d0 msgr2=0x7f806c155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806ad9d640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f806c0cf5d0 0x7f806c155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806ad9d640 1 -- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f806c0d1a80 msgr2=0x7f806c0b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:37.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806ad9d640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f806c0d1a80 0x7f806c0b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806ad9d640 1 -- 172.21.15.40:0/643054382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c0b8f20 con 0x7f806c0d2ed0 2024-09-21T01:49:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f806ad9d640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0d2ed0 0x7f806c0cbe00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8064034040 tx=0x7f80640039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f8062ffd640 1 -- 172.21.15.40:0/643054382 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806403e030 con 0x7f806c0d2ed0 2024-09-21T01:49:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f8062ffd640 1 -- 172.21.15.40:0/643054382 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80640047a0 con 0x7f806c0d2ed0 2024-09-21T01:49:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806c1f8f90 con 0x7f806c0d2ed0 2024-09-21T01:49:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f8062ffd640 1 -- 172.21.15.40:0/643054382 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8064035040 con 0x7f806c0d2ed0 2024-09-21T01:49:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.097+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806c1f9550 con 0x7f806c0d2ed0 2024-09-21T01:49:37.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.098+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806c0d0480 con 0x7f806c0d2ed0 2024-09-21T01:49:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.099+0000 7f8062ffd640 1 -- 172.21.15.40:0/643054382 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8064041030 con 0x7f806c0d2ed0 2024-09-21T01:49:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.100+0000 7f8062ffd640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f804c078b90 0x7f804c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.100+0000 7f8062ffd640 1 -- 172.21.15.40:0/643054382 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f80640bb1d0 con 0x7f806c0d2ed0 2024-09-21T01:49:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.100+0000 7f806a59c640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f804c078b90 0x7f804c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:37.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.100+0000 7f806a59c640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f804c078b90 0x7f804c07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f805c00b450 tx=0x7f805c00d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:37.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.104+0000 7f8062ffd640 1 -- 172.21.15.40:0/643054382 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f806c0d0480 con 0x7f806c0d2ed0 2024-09-21T01:49:37.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.295+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f806c1632c0 con 0x7f806c0d2ed0 2024-09-21T01:49:37.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.296+0000 7f8062ffd640 1 -- 172.21.15.40:0/643054382 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f8064083310 con 0x7f806c0d2ed0 2024-09-21T01:49:37.296 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:37.297 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-09-21T01:49:37.297 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:49:37.297 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-09-21T01:49:37.297 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-09-21T01:49:37.297 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:49:37.297 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-09-21T01:49:37.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f804c078b90 msgr2=0x7f804c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:37.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f804c078b90 0x7f804c07b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f805c00b450 tx=0x7f805c00d040 comp rx=0 tx=0).stop 2024-09-21T01:49:37.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0d2ed0 msgr2=0x7f806c0cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:37.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0d2ed0 0x7f806c0cbe00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8064034040 tx=0x7f80640039e0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 shutdown_connections 2024-09-21T01:49:37.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f804c078b90 0x7f804c07b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f806c0d2ed0 0x7f806c0cbe00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f806c0d1a80 0x7f806c0b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 --2- 172.21.15.40:0/643054382 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f806c0cf5d0 0x7f806c155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 >> 172.21.15.40:0/643054382 conn(0x7f806c08bfc0 msgr2=0x7f806c0b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:37.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 shutdown_connections 2024-09-21T01:49:37.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.298+0000 7f8070ca9640 1 -- 172.21.15.40:0/643054382 wait complete. 2024-09-21T01:49:37.310 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T01:49:37.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T01:49:37.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.431+0000 7f0655c3f640 1 -- 172.21.15.40:0/69151037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0638004d40 msgr2=0x7f0638005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:37.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.431+0000 7f0655c3f640 1 --2- 172.21.15.40:0/69151037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0638004d40 0x7f0638005150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f065015fdd0 tx=0x7f0638005830 comp rx=0 tx=0).stop 2024-09-21T01:49:37.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.431+0000 7f064ffff640 1 -- 172.21.15.40:0/69151037 reap_dead start 2024-09-21T01:49:37.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.431+0000 7f0655c3f640 1 -- 172.21.15.40:0/69151037 shutdown_connections 2024-09-21T01:49:37.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.431+0000 7f0655c3f640 1 -- 172.21.15.40:0/69151037 >> 172.21.15.40:0/69151037 conn(0x7f065008dc50 msgr2=0x7f065009d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:37.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.431+0000 7f0655c3f640 1 -- 172.21.15.40:0/69151037 shutdown_connections 2024-09-21T01:49:37.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.431+0000 7f0655c3f640 1 -- 172.21.15.40:0/69151037 wait complete. 2024-09-21T01:49:37.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.433+0000 7f0655c3f640 1 Processor -- start 2024-09-21T01:49:37.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.433+0000 7f0655c3f640 1 -- start start 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f0655c3f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0638004d40 0x7f065015c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f0655c3f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06501f8b30 0x7f06501614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f0655c3f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065015cca0 0x7f0650161a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f0655c3f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f06500d1690 con 0x7f06501f8b30 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f0655c3f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f06500d1510 con 0x7f0638004d40 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f0655c3f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f0650162790 con 0x7f065015cca0 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f064effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06501f8b30 0x7f06501614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f064effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06501f8b30 0x7f06501614e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41382/0 (socket says 172.21.15.40:41382) 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f064effd640 1 -- 172.21.15.40:0/2225764685 learned_addr learned my addr 172.21.15.40:0/2225764685 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f064ffff640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065015cca0 0x7f0650161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.434+0000 7f064f7fe640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0638004d40 0x7f065015c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f064effd640 1 -- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065015cca0 msgr2=0x7f0650161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f064effd640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065015cca0 0x7f0650161a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f064effd640 1 -- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0638004d40 msgr2=0x7f065015c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f064effd640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0638004d40 0x7f065015c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f064effd640 1 -- 172.21.15.40:0/2225764685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06501f92a0 con 0x7f06501f8b30 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f064effd640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06501f8b30 0x7f06501614e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06440019a0 tx=0x7f06440039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f0637fff640 1 -- 172.21.15.40:0/2225764685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644015070 con 0x7f06501f8b30 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f0637fff640 1 -- 172.21.15.40:0/2225764685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06440119c0 con 0x7f06501f8b30 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06501f9580 con 0x7f06501f8b30 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f0637fff640 1 -- 172.21.15.40:0/2225764685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644011e10 con 0x7f06501f8b30 2024-09-21T01:49:37.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.435+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06500a00f0 con 0x7f06501f8b30 2024-09-21T01:49:37.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.436+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06501f9010 con 0x7f06501f8b30 2024-09-21T01:49:37.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.437+0000 7f0637fff640 1 -- 172.21.15.40:0/2225764685 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0644010420 con 0x7f06501f8b30 2024-09-21T01:49:37.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.437+0000 7f0637fff640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f063c078b90 0x7f063c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.437+0000 7f0637fff640 1 -- 172.21.15.40:0/2225764685 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f064409b680 con 0x7f06501f8b30 2024-09-21T01:49:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.437+0000 7f064f7fe640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f063c078b90 0x7f063c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:37.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.438+0000 7f064f7fe640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f063c078b90 0x7f063c07b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0640009cd0 tx=0x7f0640005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.442+0000 7f0637fff640 1 -- 172.21.15.40:0/2225764685 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f06500d1840 con 0x7f06501f8b30 2024-09-21T01:49:37.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:37.631+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f065006e160 con 0x7f06501f8b30 2024-09-21T01:49:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.325+0000 7f0637fff640 1 -- 172.21.15.40:0/2225764685 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f0644063860 con 0x7f06501f8b30 2024-09-21T01:49:38.326 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-09-21T01:49:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f063c078b90 msgr2=0x7f063c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f063c078b90 0x7f063c07b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0640009cd0 tx=0x7f0640005f90 comp rx=0 tx=0).stop 2024-09-21T01:49:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06501f8b30 msgr2=0x7f06501614e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:38.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06501f8b30 0x7f06501614e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06440019a0 tx=0x7f06440039c0 comp rx=0 tx=0).stop 2024-09-21T01:49:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 shutdown_connections 2024-09-21T01:49:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f063c078b90 0x7f063c07b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f065015cca0 0x7f0650161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06501f8b30 0x7f06501614e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 --2- 172.21.15.40:0/2225764685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0638004d40 0x7f065015c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.328+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 >> 172.21.15.40:0/2225764685 conn(0x7f065008dc50 msgr2=0x7f065015dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.329+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 shutdown_connections 2024-09-21T01:49:38.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.329+0000 7f0655c3f640 1 -- 172.21.15.40:0/2225764685 wait complete. 2024-09-21T01:49:38.348 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T01:49:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.478+0000 7ff8c2da1640 1 -- 172.21.15.40:0/2443377458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 msgr2=0x7ff8bc071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.478+0000 7ff8c2da1640 1 --2- 172.21.15.40:0/2443377458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 0x7ff8bc071370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009830 tx=0x7ff8a402a510 comp rx=0 tx=0).stop 2024-09-21T01:49:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.478+0000 7ff8c2da1640 1 -- 172.21.15.40:0/2443377458 shutdown_connections 2024-09-21T01:49:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.478+0000 7ff8c2da1640 1 --2- 172.21.15.40:0/2443377458 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8bc143b20 0x7ff8bc143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.478+0000 7ff8c2da1640 1 --2- 172.21.15.40:0/2443377458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 0x7ff8bc071370 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:38.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.478+0000 7ff8c2da1640 1 -- 172.21.15.40:0/2443377458 >> 172.21.15.40:0/2443377458 conn(0x7ff8bc0d1210 msgr2=0x7ff8bc073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:38.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.478+0000 7ff8c2da1640 1 -- 172.21.15.40:0/2443377458 shutdown_connections 2024-09-21T01:49:38.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.478+0000 7ff8c2da1640 1 -- 172.21.15.40:0/2443377458 wait complete. 2024-09-21T01:49:38.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.480+0000 7ff8c2da1640 1 Processor -- start 2024-09-21T01:49:38.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.480+0000 7ff8c2da1640 1 -- start start 2024-09-21T01:49:38.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.481+0000 7ff8c2da1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc073e50 0x7ff8bc1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:38.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.481+0000 7ff8c2da1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8bc143b20 0x7ff8bc158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:38.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.481+0000 7ff8c2da1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 0x7ff8bc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.481+0000 7ff8c2da1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc1445f0 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.481+0000 7ff8c2da1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc144470 con 0x7ff8bc073e50 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.481+0000 7ff8c2da1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc144770 con 0x7ff8bc143b20 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c133e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 0x7ff8bc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c133e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 0x7ff8bc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41402/0 (socket says 172.21.15.40:41402) 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c133e640 1 -- 172.21.15.40:0/4277123068 learned_addr learned my addr 172.21.15.40:0/4277123068 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c0b3d640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc073e50 0x7ff8bc1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c133e640 1 -- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8bc143b20 msgr2=0x7ff8bc158020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c133e640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8bc143b20 0x7ff8bc158020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c133e640 1 -- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc073e50 msgr2=0x7ff8bc1564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c133e640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc073e50 0x7ff8bc1564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c133e640 1 -- 172.21.15.40:0/4277123068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc1f3ce0 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c0b3d640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc073e50 0x7ff8bc1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:38.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c133e640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 0x7ff8bc159ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400dac0 tx=0x7ff8b400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8b97fa640 1 -- 172.21.15.40:0/4277123068 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400adc0 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8b97fa640 1 -- 172.21.15.40:0/4277123068 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8b4005110 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8bc1f3fc0 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8b97fa640 1 -- 172.21.15.40:0/4277123068 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4005560 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.482+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8bc1f4580 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.483+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8bc143f30 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.484+0000 7ff8b97fa640 1 -- 172.21.15.40:0/4277123068 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8b40047a0 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.485+0000 7ff8b97fa640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff89c078bc0 0x7ff89c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.485+0000 7ff8b97fa640 1 -- 172.21.15.40:0/4277123068 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7ff8b409b0a0 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.485+0000 7ff8c0b3d640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff89c078bc0 0x7ff89c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:38.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.486+0000 7ff8c0b3d640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff89c078bc0 0x7ff89c07b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4034000 tx=0x7ff8a4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:38.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.490+0000 7ff8b97fa640 1 -- 172.21.15.40:0/4277123068 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8b4063620 con 0x7ff8bc15bcd0 2024-09-21T01:49:38.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:38.678+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff8bc070ef0 con 0x7ff8bc15bcd0 2024-09-21T01:49:39.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.331+0000 7ff8b97fa640 1 -- 172.21.15.40:0/4277123068 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7ff8b4062f20 con 0x7ff8bc15bcd0 2024-09-21T01:49:39.332 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-09-21T01:49:39.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.336+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff89c078bc0 msgr2=0x7ff89c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:39.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.336+0000 7ff8c2da1640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff89c078bc0 0x7ff89c07b0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4034000 tx=0x7ff8a4004730 comp rx=0 tx=0).stop 2024-09-21T01:49:39.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.336+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 msgr2=0x7ff8bc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:39.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.336+0000 7ff8c2da1640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 0x7ff8bc159ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400dac0 tx=0x7ff8b400df80 comp rx=0 tx=0).stop 2024-09-21T01:49:39.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.341+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 shutdown_connections 2024-09-21T01:49:39.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.342+0000 7ff8c2da1640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff89c078bc0 0x7ff89c07b0d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:39.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.342+0000 7ff8c2da1640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8bc15bcd0 0x7ff8bc159ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:39.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.342+0000 7ff8c2da1640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8bc143b20 0x7ff8bc158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:39.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.342+0000 7ff8c2da1640 1 --2- 172.21.15.40:0/4277123068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8bc073e50 0x7ff8bc1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:39.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.342+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 >> 172.21.15.40:0/4277123068 conn(0x7ff8bc0d1210 msgr2=0x7ff8bc143380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:39.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.347+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 shutdown_connections 2024-09-21T01:49:39.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.347+0000 7ff8c2da1640 1 -- 172.21.15.40:0/4277123068 wait complete. 2024-09-21T01:49:39.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T01:49:39.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.491+0000 7f20c684d640 1 -- 172.21.15.40:0/1117793897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c00cf520 msgr2=0x7f20c00ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:39.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.491+0000 7f20c684d640 1 --2- 172.21.15.40:0/1117793897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c00cf520 0x7f20c00ccad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f20c00d2320 tx=0x7f20b802aac0 comp rx=0 tx=0).stop 2024-09-21T01:49:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.491+0000 7f20c684d640 1 -- 172.21.15.40:0/1117793897 shutdown_connections 2024-09-21T01:49:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.491+0000 7f20c684d640 1 --2- 172.21.15.40:0/1117793897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c00cf520 0x7f20c00ccad0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.491+0000 7f20c684d640 1 --2- 172.21.15.40:0/1117793897 >> v2:172.21.15.139:3300/0 conn(0x7f20c015b900 0x7f20c00ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.491+0000 7f20c684d640 1 -- 172.21.15.40:0/1117793897 >> 172.21.15.40:0/1117793897 conn(0x7f20c0074170 msgr2=0x7f20c00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.491+0000 7f20c684d640 1 -- 172.21.15.40:0/1117793897 shutdown_connections 2024-09-21T01:49:39.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.491+0000 7f20c684d640 1 -- 172.21.15.40:0/1117793897 wait complete. 2024-09-21T01:49:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.493+0000 7f20c684d640 1 Processor -- start 2024-09-21T01:49:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.493+0000 7f20c684d640 1 -- start start 2024-09-21T01:49:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20c684d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20c009aa30 0x7f20c0157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20c684d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c015b900 0x7f20c00ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20c684d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20c01580d0 0x7f20c00ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20c684d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f20c00cd010 con 0x7f20c015b900 2024-09-21T01:49:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20c684d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f20c00cdec0 con 0x7f20c01580d0 2024-09-21T01:49:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20c684d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f20c00cd190 con 0x7f20c009aa30 2024-09-21T01:49:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c015b900 0x7f20c00ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:39.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c015b900 0x7f20c00ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41418/0 (socket says 172.21.15.40:41418) 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bf7fe640 1 -- 172.21.15.40:0/1093851444 learned_addr learned my addr 172.21.15.40:0/1093851444 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20c4dea640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20c01580d0 0x7f20c00ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bffff640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20c009aa30 0x7f20c0157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bf7fe640 1 -- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20c009aa30 msgr2=0x7f20c0157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bf7fe640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20c009aa30 0x7f20c0157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bf7fe640 1 -- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20c01580d0 msgr2=0x7f20c00ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bf7fe640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20c01580d0 0x7f20c00ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bf7fe640 1 -- 172.21.15.40:0/1093851444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c01f6b10 con 0x7f20c015b900 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20c4dea640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20c01580d0 0x7f20c00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bf7fe640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c015b900 0x7f20c00ce0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20b400c3a0 tx=0x7f20b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bcff9640 1 -- 172.21.15.40:0/1093851444 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4017070 con 0x7f20c015b900 2024-09-21T01:49:39.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bcff9640 1 -- 172.21.15.40:0/1093851444 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20b40053c0 con 0x7f20c015b900 2024-09-21T01:49:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20bcff9640 1 -- 172.21.15.40:0/1093851444 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4003850 con 0x7f20c015b900 2024-09-21T01:49:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.495+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c01f6df0 con 0x7f20c015b900 2024-09-21T01:49:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.496+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c01f73b0 con 0x7f20c015b900 2024-09-21T01:49:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.496+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c00cd650 con 0x7f20c015b900 2024-09-21T01:49:39.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.497+0000 7f20bcff9640 1 -- 172.21.15.40:0/1093851444 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20b401a070 con 0x7f20c015b900 2024-09-21T01:49:39.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.498+0000 7f20bcff9640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f20ac078bc0 0x7f20ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:39.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.498+0000 7f20bcff9640 1 -- 172.21.15.40:0/1093851444 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f20b409a240 con 0x7f20c015b900 2024-09-21T01:49:39.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.498+0000 7f20bffff640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f20ac078bc0 0x7f20ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:39.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.499+0000 7f20bffff640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f20ac078bc0 0x7f20ac07b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20b0004630 tx=0x7f20b000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:39.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.502+0000 7f20bcff9640 1 -- 172.21.15.40:0/1093851444 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f20b4021020 con 0x7f20c015b900 2024-09-21T01:49:39.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:39.728+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f20c0157ed0 con 0x7f20c015b900 2024-09-21T01:49:40.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.333+0000 7f20bcff9640 1 -- 172.21.15.40:0/1093851444 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f20c0157ed0 con 0x7f20c015b900 2024-09-21T01:49:40.333 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T01:49:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.341+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f20ac078bc0 msgr2=0x7f20ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.341+0000 7f20c684d640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f20ac078bc0 0x7f20ac07b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20b0004630 tx=0x7f20b000b2e0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.341+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c015b900 msgr2=0x7f20c00ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.341+0000 7f20c684d640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c015b900 0x7f20c00ce0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f20b400c3a0 tx=0x7f20b400c860 comp rx=0 tx=0).stop 2024-09-21T01:49:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.344+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 shutdown_connections 2024-09-21T01:49:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.344+0000 7f20c684d640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f20ac078bc0 0x7f20ac07b0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.344+0000 7f20c684d640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f20c01580d0 0x7f20c00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.344+0000 7f20c684d640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c015b900 0x7f20c00ce0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.344+0000 7f20c684d640 1 --2- 172.21.15.40:0/1093851444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f20c009aa30 0x7f20c0157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.344+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 >> 172.21.15.40:0/1093851444 conn(0x7f20c0074170 msgr2=0x7f20c00b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:40.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.346+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 shutdown_connections 2024-09-21T01:49:40.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.346+0000 7f20c684d640 1 -- 172.21.15.40:0/1093851444 wait complete. 2024-09-21T01:49:40.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:40.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.493+0000 7f66ac8cc640 1 -- 172.21.15.40:0/2546072701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6694004d40 msgr2=0x7f6694005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.493+0000 7f66ac8cc640 1 --2- 172.21.15.40:0/2546072701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6694004d40 0x7f6694005150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f66a8073230 tx=0x7f6694005830 comp rx=0 tx=0).stop 2024-09-21T01:49:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.493+0000 7f66a6d9d640 1 -- 172.21.15.40:0/2546072701 reap_dead start 2024-09-21T01:49:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.493+0000 7f66ac8cc640 1 -- 172.21.15.40:0/2546072701 shutdown_connections 2024-09-21T01:49:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.493+0000 7f66ac8cc640 1 -- 172.21.15.40:0/2546072701 >> 172.21.15.40:0/2546072701 conn(0x7f66a80b2160 msgr2=0x7f66a80b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.493+0000 7f66ac8cc640 1 -- 172.21.15.40:0/2546072701 shutdown_connections 2024-09-21T01:49:40.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.493+0000 7f66ac8cc640 1 -- 172.21.15.40:0/2546072701 wait complete. 2024-09-21T01:49:40.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.495+0000 7f66ac8cc640 1 Processor -- start 2024-09-21T01:49:40.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.495+0000 7f66ac8cc640 1 -- start start 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66ac8cc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6694004d40 0x7f66a8159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66ac8cc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66a8154ab0 0x7f66a8154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66ac8cc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a80a9f90 0x7f66a80aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66ac8cc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f66a80ccb60 con 0x7f66a80a9f90 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66ac8cc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f66a80cc9e0 con 0x7f6694004d40 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66ac8cc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f66a806f6e0 con 0x7f66a8154ab0 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66a6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a80a9f90 0x7f66a80aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66a6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a80a9f90 0x7f66a80aa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50706/0 (socket says 172.21.15.40:50706) 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66a6d9d640 1 -- 172.21.15.40:0/1792370522 learned_addr learned my addr 172.21.15.40:0/1792370522 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66a659c640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6694004d40 0x7f66a8159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:40.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.496+0000 7f66a5d9b640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66a8154ab0 0x7f66a8154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f66a6d9d640 1 -- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66a8154ab0 msgr2=0x7f66a8154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f66a6d9d640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66a8154ab0 0x7f66a8154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f66a6d9d640 1 -- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6694004d40 msgr2=0x7f66a8159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f66a6d9d640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6694004d40 0x7f66a8159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f66a6d9d640 1 -- 172.21.15.40:0/1792370522 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a8155400 con 0x7f66a80a9f90 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f66a6d9d640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a80a9f90 0x7f66a80aa3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009a70 tx=0x7f66a0033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f669effd640 1 -- 172.21.15.40:0/1792370522 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0038040 con 0x7f66a80a9f90 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f669effd640 1 -- 172.21.15.40:0/1792370522 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66a0042070 con 0x7f66a80a9f90 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a8159a40 con 0x7f66a80a9f90 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f669effd640 1 -- 172.21.15.40:0/1792370522 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a0009720 con 0x7f66a80a9f90 2024-09-21T01:49:40.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.497+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a81f29f0 con 0x7f66a80a9f90 2024-09-21T01:49:40.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.498+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a80b4670 con 0x7f66a80a9f90 2024-09-21T01:49:40.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.499+0000 7f669effd640 1 -- 172.21.15.40:0/1792370522 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66a0033a40 con 0x7f66a80a9f90 2024-09-21T01:49:40.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.499+0000 7f669effd640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6688078bc0 0x7f668807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:40.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.499+0000 7f669effd640 1 -- 172.21.15.40:0/1792370522 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f66a00bb240 con 0x7f66a80a9f90 2024-09-21T01:49:40.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.500+0000 7f66a659c640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6688078bc0 0x7f668807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:40.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.500+0000 7f66a659c640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6688078bc0 0x7f668807b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f66980016b0 tx=0x7f6698005040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:40.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.504+0000 7f669effd640 1 -- 172.21.15.40:0/1792370522 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f66a8155400 con 0x7f66a80a9f90 2024-09-21T01:49:40.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.694+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66a80b1240 con 0x7f66a80a9f90 2024-09-21T01:49:40.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.696+0000 7f669effd640 1 -- 172.21.15.40:0/1792370522 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16690 (secure 0 0 0) 0x7f66a00830c0 con 0x7f66a80a9f90 2024-09-21T01:49:40.697 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:40.697 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:39.729501+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:49:37.635417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:49:38.682453+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:40.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6688078bc0 msgr2=0x7f668807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6688078bc0 0x7f668807b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f66980016b0 tx=0x7f6698005040 comp rx=0 tx=0).stop 2024-09-21T01:49:40.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a80a9f90 msgr2=0x7f66a80aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a80a9f90 0x7f66a80aa3a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f66a0009a70 tx=0x7f66a0033670 comp rx=0 tx=0).stop 2024-09-21T01:49:40.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 shutdown_connections 2024-09-21T01:49:40.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6688078bc0 0x7f668807b0d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66a80a9f90 0x7f66a80aa3a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66a8154ab0 0x7f66a8154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 --2- 172.21.15.40:0/1792370522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6694004d40 0x7f66a8159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 >> 172.21.15.40:0/1792370522 conn(0x7f66a80b2160 msgr2=0x7f66a80b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:40.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 shutdown_connections 2024-09-21T01:49:40.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.698+0000 7f66ac8cc640 1 -- 172.21.15.40:0/1792370522 wait complete. 2024-09-21T01:49:40.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.824+0000 7f5a732a2640 1 -- 172.21.15.40:0/1764695910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0d2ed0 msgr2=0x7f5a6c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.824+0000 7f5a732a2640 1 --2- 172.21.15.40:0/1764695910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0d2ed0 0x7f5a6c0d1a80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009820 tx=0x7f5a6802a510 comp rx=0 tx=0).stop 2024-09-21T01:49:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.824+0000 7f5a732a2640 1 -- 172.21.15.40:0/1764695910 shutdown_connections 2024-09-21T01:49:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.824+0000 7f5a732a2640 1 --2- 172.21.15.40:0/1764695910 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a6c0b9b70 0x7f5a6c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.824+0000 7f5a732a2640 1 --2- 172.21.15.40:0/1764695910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0d2ed0 0x7f5a6c0d1a80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.824+0000 7f5a732a2640 1 -- 172.21.15.40:0/1764695910 >> 172.21.15.40:0/1764695910 conn(0x7f5a6c08bfc0 msgr2=0x7f5a6c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.824+0000 7f5a732a2640 1 -- 172.21.15.40:0/1764695910 shutdown_connections 2024-09-21T01:49:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.825+0000 7f5a732a2640 1 -- 172.21.15.40:0/1764695910 wait complete. 2024-09-21T01:49:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.826+0000 7f5a732a2640 1 Processor -- start 2024-09-21T01:49:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.826+0000 7f5a732a2640 1 -- start start 2024-09-21T01:49:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.827+0000 7f5a732a2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a6c0b9b70 0x7f5a6c151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.827+0000 7f5a732a2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cf5d0 0x7f5a6c14e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a732a2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a6c0d2ed0 0x7f5a6c1f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a732a2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0d4940 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a732a2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6c0cfde0 con 0x7f5a6c0d2ed0 2024-09-21T01:49:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a732a2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6c0d4ac0 con 0x7f5a6c0b9b70 2024-09-21T01:49:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7083d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cf5d0 0x7f5a6c14e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7083d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cf5d0 0x7f5a6c14e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50724/0 (socket says 172.21.15.40:50724) 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7083d640 1 -- 172.21.15.40:0/825734704 learned_addr learned my addr 172.21.15.40:0/825734704 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7183f640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a6c0d2ed0 0x7f5a6c1f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7103e640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a6c0b9b70 0x7f5a6c151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7083d640 1 -- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a6c0b9b70 msgr2=0x7f5a6c151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7083d640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a6c0b9b70 0x7f5a6c151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7083d640 1 -- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a6c0d2ed0 msgr2=0x7f5a6c1f8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7083d640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a6c0d2ed0 0x7f5a6c1f8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7083d640 1 -- 172.21.15.40:0/825734704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6c152160 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a7083d640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cf5d0 0x7f5a6c14e950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00e7c0 tx=0x7f5a5c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a61ffb640 1 -- 172.21.15.40:0/825734704 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00ccc0 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a61ffb640 1 -- 172.21.15.40:0/825734704 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a5c00ce60 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6c14ee90 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.828+0000 7f5a61ffb640 1 -- 172.21.15.40:0/825734704 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c005280 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.829+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a6c0c9a40 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.830+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a6c0d5050 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.830+0000 7f5a61ffb640 1 -- 172.21.15.40:0/825734704 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a5c005420 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.831+0000 7f5a61ffb640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5a50078b90 0x7f5a5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.831+0000 7f5a61ffb640 1 -- 172.21.15.40:0/825734704 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5a5c09b740 con 0x7f5a6c0cf5d0 2024-09-21T01:49:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.831+0000 7f5a7103e640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5a50078b90 0x7f5a5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.832+0000 7f5a7103e640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5a50078b90 0x7f5a5007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a68034000 tx=0x7f5a68004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:40.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:40.835+0000 7f5a61ffb640 1 -- 172.21.15.40:0/825734704 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5a6c152160 con 0x7f5a6c0cf5d0 2024-09-21T01:49:41.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.026+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a6c0b4020 con 0x7f5a6c0cf5d0 2024-09-21T01:49:41.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.027+0000 7f5a61ffb640 1 -- 172.21.15.40:0/825734704 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16690 (secure 0 0 0) 0x7f5a5c063b00 con 0x7f5a6c0cf5d0 2024-09-21T01:49:41.028 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:41.028 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:39.729501+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:49:37.635417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:49:38.682453+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:41.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5a50078b90 msgr2=0x7f5a5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5a50078b90 0x7f5a5007b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a68034000 tx=0x7f5a68004730 comp rx=0 tx=0).stop 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cf5d0 msgr2=0x7f5a6c14e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cf5d0 0x7f5a6c14e950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00e7c0 tx=0x7f5a5c00ec80 comp rx=0 tx=0).stop 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 shutdown_connections 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5a50078b90 0x7f5a5007b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a6c0d2ed0 0x7f5a6c1f8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cf5d0 0x7f5a6c14e950 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 --2- 172.21.15.40:0/825734704 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5a6c0b9b70 0x7f5a6c151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 >> 172.21.15.40:0/825734704 conn(0x7f5a6c08bfc0 msgr2=0x7f5a6c06f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 shutdown_connections 2024-09-21T01:49:41.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.030+0000 7f5a732a2640 1 -- 172.21.15.40:0/825734704 wait complete. 2024-09-21T01:49:41.041 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T01:49:41.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.159+0000 7f997cdda640 1 -- 172.21.15.40:0/2828860253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6100 msgr2=0x7f99780b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:41.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.159+0000 7f997cdda640 1 --2- 172.21.15.40:0/2828860253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6100 0x7f99780b14f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9978074f60 tx=0x7f996c02a4b0 comp rx=0 tx=0).stop 2024-09-21T01:49:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.159+0000 7f997cdda640 1 -- 172.21.15.40:0/2828860253 shutdown_connections 2024-09-21T01:49:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.159+0000 7f997cdda640 1 --2- 172.21.15.40:0/2828860253 >> v2:172.21.15.139:3300/0 conn(0x7f9978162f60 0x7f9978165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.159+0000 7f997cdda640 1 --2- 172.21.15.40:0/2828860253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6100 0x7f99780b14f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.159+0000 7f997cdda640 1 -- 172.21.15.40:0/2828860253 >> 172.21.15.40:0/2828860253 conn(0x7f99780d12a0 msgr2=0x7f99780d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.159+0000 7f997cdda640 1 -- 172.21.15.40:0/2828860253 shutdown_connections 2024-09-21T01:49:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.160+0000 7f997cdda640 1 -- 172.21.15.40:0/2828860253 wait complete. 2024-09-21T01:49:41.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.161+0000 7f997cdda640 1 Processor -- start 2024-09-21T01:49:41.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.161+0000 7f997cdda640 1 -- start start 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f997cdda640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99780b6100 0x7f997815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f997cdda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6680 0x7f99780af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f997cdda640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9978162f60 0x7f99780af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f997cdda640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9978165a40 con 0x7f99780b6680 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f997cdda640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f99781658c0 con 0x7f99780b6100 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f997cdda640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f9978165bc0 con 0x7f9978162f60 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9975d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6680 0x7f99780af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9975d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6680 0x7f99780af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50734/0 (socket says 172.21.15.40:50734) 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9975d9b640 1 -- 172.21.15.40:0/2961715559 learned_addr learned my addr 172.21.15.40:0/2961715559 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:41.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f997659c640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99780b6100 0x7f997815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9975d9b640 1 -- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9978162f60 msgr2=0x7f99780af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9976d9d640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9978162f60 0x7f99780af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9975d9b640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9978162f60 0x7f99780af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9975d9b640 1 -- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99780b6100 msgr2=0x7f997815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9975d9b640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99780b6100 0x7f997815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9975d9b640 1 -- 172.21.15.40:0/2961715559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99781f7930 con 0x7f99780b6680 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f997659c640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99780b6100 0x7f997815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9975d9b640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6680 0x7f99780af080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f996c000c00 tx=0x7f996c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.163+0000 7f9966ffd640 1 -- 172.21.15.40:0/2961715559 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c03e030 con 0x7f99780b6680 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.164+0000 7f9966ffd640 1 -- 172.21.15.40:0/2961715559 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f996c003e00 con 0x7f99780b6680 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.164+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99780cace0 con 0x7f99780b6680 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.164+0000 7f9966ffd640 1 -- 172.21.15.40:0/2961715559 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c035040 con 0x7f99780b6680 2024-09-21T01:49:41.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.164+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f997815c650 con 0x7f99780b6680 2024-09-21T01:49:41.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.164+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99780b0de0 con 0x7f99780b6680 2024-09-21T01:49:41.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.165+0000 7f9966ffd640 1 -- 172.21.15.40:0/2961715559 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f996c041030 con 0x7f99780b6680 2024-09-21T01:49:41.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.166+0000 7f9966ffd640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9958078bc0 0x7f995807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:41.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.166+0000 7f9966ffd640 1 -- 172.21.15.40:0/2961715559 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f996c0bb450 con 0x7f99780b6680 2024-09-21T01:49:41.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.166+0000 7f997659c640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9958078bc0 0x7f995807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:41.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.167+0000 7f997659c640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9958078bc0 0x7f995807b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99780ceda0 tx=0x7f9968008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:41.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.170+0000 7f9966ffd640 1 -- 172.21.15.40:0/2961715559 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f996c083920 con 0x7f99780b6680 2024-09-21T01:49:41.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:41.399+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9978162370 con 0x7f99780b6680 2024-09-21T01:49:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.355+0000 7f9966ffd640 1 -- 172.21.15.40:0/2961715559 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f996c083220 con 0x7f99780b6680 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9958078bc0 msgr2=0x7f995807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9958078bc0 0x7f995807b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99780ceda0 tx=0x7f9968008040 comp rx=0 tx=0).stop 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6680 msgr2=0x7f99780af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6680 0x7f99780af080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f996c000c00 tx=0x7f996c003910 comp rx=0 tx=0).stop 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 shutdown_connections 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9958078bc0 0x7f995807b0d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9978162f60 0x7f99780af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99780b6680 0x7f99780af080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 --2- 172.21.15.40:0/2961715559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f99780b6100 0x7f997815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 >> 172.21.15.40:0/2961715559 conn(0x7f99780d12a0 msgr2=0x7f997806ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 shutdown_connections 2024-09-21T01:49:42.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.358+0000 7f997cdda640 1 -- 172.21.15.40:0/2961715559 wait complete. 2024-09-21T01:49:42.372 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T01:49:42.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T01:49:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.499+0000 7f237aba1640 1 -- 172.21.15.40:0/1497344393 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23740ccbd0 msgr2=0x7f23740d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.499+0000 7f237aba1640 1 --2- 172.21.15.40:0/1497344393 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23740ccbd0 0x7f23740d0d80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2368009830 tx=0x7f236802a510 comp rx=0 tx=0).stop 2024-09-21T01:49:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.499+0000 7f237aba1640 1 -- 172.21.15.40:0/1497344393 shutdown_connections 2024-09-21T01:49:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.499+0000 7f237aba1640 1 --2- 172.21.15.40:0/1497344393 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23740ccbd0 0x7f23740d0d80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.499+0000 7f237aba1640 1 --2- 172.21.15.40:0/1497344393 >> v2:172.21.15.139:3300/0 conn(0x7f23740b51c0 0x7f237415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.499+0000 7f237aba1640 1 -- 172.21.15.40:0/1497344393 >> 172.21.15.40:0/1497344393 conn(0x7f2374072ae0 msgr2=0x7f2374072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.499+0000 7f237aba1640 1 -- 172.21.15.40:0/1497344393 shutdown_connections 2024-09-21T01:49:42.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.499+0000 7f237aba1640 1 -- 172.21.15.40:0/1497344393 wait complete. 2024-09-21T01:49:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.501+0000 7f237aba1640 1 Processor -- start 2024-09-21T01:49:42.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.501+0000 7f237aba1640 1 -- start start 2024-09-21T01:49:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f237aba1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23740b51c0 0x7f237414c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f237aba1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23740ccbd0 0x7f237414c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f237aba1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23740d12c0 0x7f237414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f237aba1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2374160a60 con 0x7f23740ccbd0 2024-09-21T01:49:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f237aba1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f23740d1a20 con 0x7f23740d12c0 2024-09-21T01:49:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f237aba1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f2374160be0 con 0x7f23740b51c0 2024-09-21T01:49:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f2373fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23740ccbd0 0x7f237414c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:42.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f2373fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23740ccbd0 0x7f237414c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50746/0 (socket says 172.21.15.40:50746) 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f2373fff640 1 -- 172.21.15.40:0/2524606750 learned_addr learned my addr 172.21.15.40:0/2524606750 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f237913e640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23740d12c0 0x7f237414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.502+0000 7f237893d640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23740b51c0 0x7f237414c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f2373fff640 1 -- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23740b51c0 msgr2=0x7f237414c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f2373fff640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23740b51c0 0x7f237414c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f2373fff640 1 -- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23740d12c0 msgr2=0x7f237414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f2373fff640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23740d12c0 0x7f237414cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f2373fff640 1 -- 172.21.15.40:0/2524606750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237414b880 con 0x7f23740ccbd0 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f237913e640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23740d12c0 0x7f237414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f2373fff640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23740ccbd0 0x7f237414c830 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2368009950 tx=0x7f2368033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f23717fa640 1 -- 172.21.15.40:0/2524606750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2368031d60 con 0x7f23740ccbd0 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f23717fa640 1 -- 172.21.15.40:0/2524606750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2368033e10 con 0x7f23740ccbd0 2024-09-21T01:49:42.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23740ab340 con 0x7f23740ccbd0 2024-09-21T01:49:42.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f23717fa640 1 -- 172.21.15.40:0/2524606750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2368033310 con 0x7f23740ccbd0 2024-09-21T01:49:42.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.503+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237414bdd0 con 0x7f23740ccbd0 2024-09-21T01:49:42.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.504+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23740ab0b0 con 0x7f23740ccbd0 2024-09-21T01:49:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.505+0000 7f23717fa640 1 -- 172.21.15.40:0/2524606750 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23680334b0 con 0x7f23740ccbd0 2024-09-21T01:49:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.505+0000 7f23717fa640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f2360078b90 0x7f236007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.505+0000 7f23717fa640 1 -- 172.21.15.40:0/2524606750 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f23680bc0c0 con 0x7f23740ccbd0 2024-09-21T01:49:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.506+0000 7f237893d640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f2360078b90 0x7f236007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:42.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.506+0000 7f237893d640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f2360078b90 0x7f236007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23640099a0 tx=0x7f2364009500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:42.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.510+0000 7f23717fa640 1 -- 172.21.15.40:0/2524606750 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f236803f030 con 0x7f23740ccbd0 2024-09-21T01:49:42.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:42.735+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2374161090 con 0x7f23740ccbd0 2024-09-21T01:49:43.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.360+0000 7f23717fa640 1 -- 172.21.15.40:0/2524606750 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f2368083eb0 con 0x7f23740ccbd0 2024-09-21T01:49:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f2360078b90 msgr2=0x7f236007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f2360078b90 0x7f236007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f23640099a0 tx=0x7f2364009500 comp rx=0 tx=0).stop 2024-09-21T01:49:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23740ccbd0 msgr2=0x7f237414c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23740ccbd0 0x7f237414c830 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2368009950 tx=0x7f2368033c20 comp rx=0 tx=0).stop 2024-09-21T01:49:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 shutdown_connections 2024-09-21T01:49:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f2360078b90 0x7f236007b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23740d12c0 0x7f237414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23740ccbd0 0x7f237414c830 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 --2- 172.21.15.40:0/2524606750 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f23740b51c0 0x7f237414c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.363+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 >> 172.21.15.40:0/2524606750 conn(0x7f2374072ae0 msgr2=0x7f23740b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:43.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.364+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 shutdown_connections 2024-09-21T01:49:43.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.364+0000 7f237aba1640 1 -- 172.21.15.40:0/2524606750 wait complete. 2024-09-21T01:49:43.378 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T01:49:43.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:49:43.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.500+0000 7f0e76f43640 1 -- 172.21.15.40:0/1395247925 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e7006e170 msgr2=0x7f0e700b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.500+0000 7f0e76f43640 1 --2- 172.21.15.40:0/1395247925 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e7006e170 0x7f0e700b3540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e60005fd0 tx=0x7f0e6002a540 comp rx=0 tx=0).stop 2024-09-21T01:49:43.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.500+0000 7f0e76f43640 1 -- 172.21.15.40:0/1395247925 shutdown_connections 2024-09-21T01:49:43.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.500+0000 7f0e76f43640 1 --2- 172.21.15.40:0/1395247925 >> v2:172.21.15.139:3300/0 conn(0x7f0e700ceb40 0x7f0e700cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.500+0000 7f0e76f43640 1 --2- 172.21.15.40:0/1395247925 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e7006e170 0x7f0e700b3540 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.500+0000 7f0e76f43640 1 -- 172.21.15.40:0/1395247925 >> 172.21.15.40:0/1395247925 conn(0x7f0e7008bfc0 msgr2=0x7f0e7009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:43.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.500+0000 7f0e76f43640 1 -- 172.21.15.40:0/1395247925 shutdown_connections 2024-09-21T01:49:43.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.501+0000 7f0e76f43640 1 -- 172.21.15.40:0/1395247925 wait complete. 2024-09-21T01:49:43.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.502+0000 7f0e76f43640 1 Processor -- start 2024-09-21T01:49:43.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.502+0000 7f0e76f43640 1 -- start start 2024-09-21T01:49:43.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e76f43640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e7006f4b0 0x7f0e70151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:43.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e76f43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e700ceb40 0x7f0e70151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:43.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e76f43640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e700cdd40 0x7f0e70151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:43.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e76f43640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0e700d0e60 con 0x7f0e700ceb40 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e76f43640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0e700d0ce0 con 0x7f0e700cdd40 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e76f43640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f0e700d0fe0 con 0x7f0e7006f4b0 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e6ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e700ceb40 0x7f0e70151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e6ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e700ceb40 0x7f0e70151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50754/0 (socket says 172.21.15.40:50754) 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e6ffff640 1 -- 172.21.15.40:0/948708889 learned_addr learned my addr 172.21.15.40:0/948708889 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e754e0640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e700cdd40 0x7f0e70151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e74cdf640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e7006f4b0 0x7f0e70151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e6ffff640 1 -- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e7006f4b0 msgr2=0x7f0e70151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e6ffff640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e7006f4b0 0x7f0e70151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e6ffff640 1 -- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e700cdd40 msgr2=0x7f0e70151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e6ffff640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e700cdd40 0x7f0e70151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e6ffff640 1 -- 172.21.15.40:0/948708889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e70151790 con 0x7f0e700ceb40 2024-09-21T01:49:43.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e754e0640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e700cdd40 0x7f0e70151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:43.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e74cdf640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e7006f4b0 0x7f0e70151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:43.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.504+0000 7f0e6ffff640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e700ceb40 0x7f0e70151aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c3f0 tx=0x7f0e6400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:43.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.505+0000 7f0e6d7fa640 1 -- 172.21.15.40:0/948708889 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64017070 con 0x7f0e700ceb40 2024-09-21T01:49:43.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.505+0000 7f0e6d7fa640 1 -- 172.21.15.40:0/948708889 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e640053c0 con 0x7f0e700ceb40 2024-09-21T01:49:43.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.505+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e70152520 con 0x7f0e700ceb40 2024-09-21T01:49:43.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.505+0000 7f0e6d7fa640 1 -- 172.21.15.40:0/948708889 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64003850 con 0x7f0e700ceb40 2024-09-21T01:49:43.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.505+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e700ccf80 con 0x7f0e700ceb40 2024-09-21T01:49:43.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.506+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e700d15a0 con 0x7f0e700ceb40 2024-09-21T01:49:43.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.507+0000 7f0e6d7fa640 1 -- 172.21.15.40:0/948708889 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e6401a070 con 0x7f0e700ceb40 2024-09-21T01:49:43.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.507+0000 7f0e6d7fa640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0e5c078b90 0x7f0e5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:43.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.507+0000 7f0e6d7fa640 1 -- 172.21.15.40:0/948708889 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0e6409a060 con 0x7f0e700ceb40 2024-09-21T01:49:43.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.507+0000 7f0e74cdf640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0e5c078b90 0x7f0e5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:43.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.508+0000 7f0e74cdf640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0e5c078b90 0x7f0e5c07b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e60033000 tx=0x7f0e60004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:43.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.512+0000 7f0e6d7fa640 1 -- 172.21.15.40:0/948708889 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0e640624b0 con 0x7f0e700ceb40 2024-09-21T01:49:43.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.735+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e700cca30 con 0x7f0e700ceb40 2024-09-21T01:49:43.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.735+0000 7f0e6d7fa640 1 -- 172.21.15.40:0/948708889 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f0e64061db0 con 0x7f0e700ceb40 2024-09-21T01:49:43.736 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:43.736 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-21T01:49:43:356671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1396929132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1396929132},{"type":"v1","addr":"172.21.15.40:6835","nonce":1396929132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/4017969431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4017969431},{"type":"v1","addr":"172.21.15.139:6836","nonce":4017969431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:49:39.729464+0000","modified":"2024-09-21T01:49:42.736647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6837/1192218063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":1192218063},{"type":"v1","addr":"172.21.15.139:6837","nonce":1192218063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T01:49:43.736 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-21T01:49:43.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0e5c078b90 msgr2=0x7f0e5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0e5c078b90 0x7f0e5c07b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e60033000 tx=0x7f0e60004730 comp rx=0 tx=0).stop 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e700ceb40 msgr2=0x7f0e70151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e700ceb40 0x7f0e70151aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0e6400c3f0 tx=0x7f0e6400c8b0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 shutdown_connections 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0e5c078b90 0x7f0e5c07b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e700cdd40 0x7f0e70151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e700ceb40 0x7f0e70151aa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 --2- 172.21.15.40:0/948708889 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0e7006f4b0 0x7f0e70151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 >> 172.21.15.40:0/948708889 conn(0x7f0e7008bfc0 msgr2=0x7f0e7006eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 shutdown_connections 2024-09-21T01:49:43.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.738+0000 7f0e76f43640 1 -- 172.21.15.40:0/948708889 wait complete. 2024-09-21T01:49:43.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.864+0000 7f0c7e36a640 1 -- 172.21.15.40:0/4091014683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780cd360 msgr2=0x7f0c7815c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.864+0000 7f0c7e36a640 1 --2- 172.21.15.40:0/4091014683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780cd360 0x7f0c7815c6a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0c780d22c0 tx=0x7f0c6802a4d0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.865+0000 7f0c7e36a640 1 -- 172.21.15.40:0/4091014683 shutdown_connections 2024-09-21T01:49:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.865+0000 7f0c7e36a640 1 --2- 172.21.15.40:0/4091014683 >> v2:172.21.15.139:3300/0 conn(0x7f0c780b7fe0 0x7f0c780ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.865+0000 7f0c7e36a640 1 --2- 172.21.15.40:0/4091014683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780cd360 0x7f0c7815c6a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.865+0000 7f0c7e36a640 1 -- 172.21.15.40:0/4091014683 >> 172.21.15.40:0/4091014683 conn(0x7f0c780710b0 msgr2=0x7f0c780714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.865+0000 7f0c7e36a640 1 -- 172.21.15.40:0/4091014683 shutdown_connections 2024-09-21T01:49:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.865+0000 7f0c7e36a640 1 -- 172.21.15.40:0/4091014683 wait complete. 2024-09-21T01:49:43.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.866+0000 7f0c7e36a640 1 Processor -- start 2024-09-21T01:49:43.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.867+0000 7f0c7e36a640 1 -- start start 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c7e36a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780b7fe0 0x7f0c781f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c7e36a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c780cd360 0x7f0c781f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c7e36a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780cf270 0x7f0c780c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c7e36a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0c78072f60 con 0x7f0c780b7fe0 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c7e36a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0c780d13b0 con 0x7f0c780cd360 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c7e36a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f0c780730e0 con 0x7f0c780cf270 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c77fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780b7fe0 0x7f0c781f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c77fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780b7fe0 0x7f0c781f3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50768/0 (socket says 172.21.15.40:50768) 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c77fff640 1 -- 172.21.15.40:0/684503734 learned_addr learned my addr 172.21.15.40:0/684503734 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c777fe640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c780cd360 0x7f0c781f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c7c907640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780cf270 0x7f0c780c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c77fff640 1 -- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780cf270 msgr2=0x7f0c780c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c77fff640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780cf270 0x7f0c780c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c77fff640 1 -- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c780cd360 msgr2=0x7f0c781f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c77fff640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c780cd360 0x7f0c781f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.868+0000 7f0c77fff640 1 -- 172.21.15.40:0/684503734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c781f0dd0 con 0x7f0c780b7fe0 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.869+0000 7f0c77fff640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780b7fe0 0x7f0c781f3e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c680099c0 tx=0x7f0c680039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.869+0000 7f0c74ff9640 1 -- 172.21.15.40:0/684503734 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6803e030 con 0x7f0c780b7fe0 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.869+0000 7f0c74ff9640 1 -- 172.21.15.40:0/684503734 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c680047a0 con 0x7f0c780b7fe0 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.869+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c78160180 con 0x7f0c780b7fe0 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.869+0000 7f0c74ff9640 1 -- 172.21.15.40:0/684503734 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68035040 con 0x7f0c780b7fe0 2024-09-21T01:49:43.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.869+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c781f46d0 con 0x7f0c780b7fe0 2024-09-21T01:49:43.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.870+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7815bc10 con 0x7f0c780b7fe0 2024-09-21T01:49:43.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.871+0000 7f0c74ff9640 1 -- 172.21.15.40:0/684503734 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c68041030 con 0x7f0c780b7fe0 2024-09-21T01:49:43.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.871+0000 7f0c74ff9640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0c64078b90 0x7f0c6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:43.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.871+0000 7f0c74ff9640 1 -- 172.21.15.40:0/684503734 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0c680bb3e0 con 0x7f0c780b7fe0 2024-09-21T01:49:43.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.872+0000 7f0c777fe640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0c64078b90 0x7f0c6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:43.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.872+0000 7f0c777fe640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0c64078b90 0x7f0c6407b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0c780aa760 tx=0x7f0c6c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:43.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:43.876+0000 7f0c74ff9640 1 -- 172.21.15.40:0/684503734 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0c780cf680 con 0x7f0c780b7fe0 2024-09-21T01:49:44.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.066+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c781606a0 con 0x7f0c780b7fe0 2024-09-21T01:49:44.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.067+0000 7f0c74ff9640 1 -- 172.21.15.40:0/684503734 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7f0c68088e20 con 0x7f0c780b7fe0 2024-09-21T01:49:44.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:44.068 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:41.342237+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:49:37.635417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:49:38.682453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:44.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0c64078b90 msgr2=0x7f0c6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0c64078b90 0x7f0c6407b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0c780aa760 tx=0x7f0c6c00b2e0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780b7fe0 msgr2=0x7f0c781f3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780b7fe0 0x7f0c781f3e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c680099c0 tx=0x7f0c680039e0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 shutdown_connections 2024-09-21T01:49:44.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0c64078b90 0x7f0c6407b0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0c780cf270 0x7f0c780c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0c780cd360 0x7f0c781f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 --2- 172.21.15.40:0/684503734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c780b7fe0 0x7f0c781f3e60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.069+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 >> 172.21.15.40:0/684503734 conn(0x7f0c780710b0 msgr2=0x7f0c780b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:44.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.070+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 shutdown_connections 2024-09-21T01:49:44.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.070+0000 7f0c7e36a640 1 -- 172.21.15.40:0/684503734 wait complete. 2024-09-21T01:49:44.082 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T01:49:44.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:49:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.198+0000 7f2526189640 1 -- 172.21.15.40:0/2187336978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25080039e0 msgr2=0x7f2508003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.198+0000 7f2526189640 1 --2- 172.21.15.40:0/2187336978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25080039e0 0x7f2508003e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2510009b40 tx=0x7f2508005830 comp rx=0 tx=0).stop 2024-09-21T01:49:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.198+0000 7f251ffff640 1 -- 172.21.15.40:0/2187336978 reap_dead start 2024-09-21T01:49:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.199+0000 7f2526189640 1 -- 172.21.15.40:0/2187336978 shutdown_connections 2024-09-21T01:49:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.199+0000 7f2526189640 1 -- 172.21.15.40:0/2187336978 >> 172.21.15.40:0/2187336978 conn(0x7f252009d870 msgr2=0x7f25200d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.199+0000 7f2526189640 1 -- 172.21.15.40:0/2187336978 shutdown_connections 2024-09-21T01:49:44.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.199+0000 7f2526189640 1 -- 172.21.15.40:0/2187336978 wait complete. 2024-09-21T01:49:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.200+0000 7f2526189640 1 Processor -- start 2024-09-21T01:49:44.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.201+0000 7f2526189640 1 -- start start 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f2526189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25080039e0 0x7f252014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f2526189640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25200ca440 0x7f25200ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f2526189640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25201f8270 0x7f25201f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f2526189640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f25200cfed0 con 0x7f25201f8270 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f2526189640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f25200cfd50 con 0x7f25080039e0 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f2526189640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f25200d3910 con 0x7f25200ca440 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25201f8270 0x7f25201f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25201f8270 0x7f25201f8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50794/0 (socket says 172.21.15.40:50794) 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251ffff640 1 -- 172.21.15.40:0/928412581 learned_addr learned my addr 172.21.15.40:0/928412581 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:44.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251ffff640 1 -- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25200ca440 msgr2=0x7f25200ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251effd640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25200ca440 0x7f25200ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251ffff640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25200ca440 0x7f25200ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251f7fe640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25080039e0 0x7f252014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251ffff640 1 -- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25080039e0 msgr2=0x7f252014e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251ffff640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25080039e0 0x7f252014e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251ffff640 1 -- 172.21.15.40:0/928412581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2520154ae0 con 0x7f25201f8270 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.202+0000 7f251ffff640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25201f8270 0x7f25201f8680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f25200d4470 tx=0x7f2518006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.203+0000 7f2507fff640 1 -- 172.21.15.40:0/928412581 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251800fa80 con 0x7f25201f8270 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.203+0000 7f2507fff640 1 -- 172.21.15.40:0/928412581 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f251800fc60 con 0x7f25201f8270 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.203+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25200cdde0 con 0x7f25201f8270 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.203+0000 7f2507fff640 1 -- 172.21.15.40:0/928412581 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518011690 con 0x7f25201f8270 2024-09-21T01:49:44.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.203+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25200ce3a0 con 0x7f25201f8270 2024-09-21T01:49:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.204+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f252006e830 con 0x7f25201f8270 2024-09-21T01:49:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.205+0000 7f2507fff640 1 -- 172.21.15.40:0/928412581 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2518011830 con 0x7f25201f8270 2024-09-21T01:49:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.205+0000 7f2507fff640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f250c078b90 0x7f250c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.205+0000 7f2507fff640 1 -- 172.21.15.40:0/928412581 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f251809b670 con 0x7f25201f8270 2024-09-21T01:49:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.206+0000 7f251f7fe640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f250c078b90 0x7f250c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.206+0000 7f251f7fe640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f250c078b90 0x7f250c07b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2510035000 tx=0x7f25100046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:44.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.210+0000 7f2507fff640 1 -- 172.21.15.40:0/928412581 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2518063ab0 con 0x7f25201f8270 2024-09-21T01:49:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.395+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 --> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25200ce570 con 0x7f250c078b90 2024-09-21T01:49:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.400+0000 7f2507fff640 1 -- 172.21.15.40:0/928412581 <== mgr.4100 v2:172.21.15.139:6800/852736644 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242254 (secure 0 0 0) 0x7f25200ce570 con 0x7f250c078b90 2024-09-21T01:49:44.402 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-21T01:49:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.402+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f250c078b90 msgr2=0x7f250c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.402+0000 7f2526189640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f250c078b90 0x7f250c07b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2510035000 tx=0x7f25100046c0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.402+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25201f8270 msgr2=0x7f25201f8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.402+0000 7f2526189640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25201f8270 0x7f25201f8680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f25200d4470 tx=0x7f2518006720 comp rx=0 tx=0).stop 2024-09-21T01:49:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.403+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 shutdown_connections 2024-09-21T01:49:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.403+0000 7f2526189640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f250c078b90 0x7f250c07b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.403+0000 7f2526189640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25201f8270 0x7f25201f8680 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.403+0000 7f2526189640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f25200ca440 0x7f25200ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.403+0000 7f2526189640 1 --2- 172.21.15.40:0/928412581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25080039e0 0x7f252014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.403+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 >> 172.21.15.40:0/928412581 conn(0x7f252009d870 msgr2=0x7f25200d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.403+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 shutdown_connections 2024-09-21T01:49:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.403+0000 7f2526189640 1 -- 172.21.15.40:0/928412581 wait complete. 2024-09-21T01:49:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T01:49:43.309551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218920,"kb_used_data":2572,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755800,"statfs":{"total":773094113280,"available":772869939200,"internally_reserved":0,"allocated":2633728,"data_stored":1634715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.979701"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736421+0000","last_change":"2024-09-21T01:49:40.366361+0000","last_active":"2024-09-21T01:49:41.736421+0000","last_peered":"2024-09-21T01:49:41.736421+0000","last_clean":"2024-09-21T01:49:41.736421+0000","last_became_active":"2024-09-21T01:49:40.366008+0000","last_became_peered":"2024-09-21T01:49:40.366008+0000","last_unstale":"2024-09-21T01:49:41.736421+0000","last_undegraded":"2024-09-21T01:49:41.736421+0000","last_fullsized":"2024-09-21T01:49:41.736421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:30.129619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736359+0000","last_change":"2024-09-21T01:49:40.364466+0000","last_active":"2024-09-21T01:49:41.736359+0000","last_peered":"2024-09-21T01:49:41.736359+0000","last_clean":"2024-09-21T01:49:41.736359+0000","last_became_active":"2024-09-21T01:49:40.364098+0000","last_became_peered":"2024-09-21T01:49:40.364098+0000","last_unstale":"2024-09-21T01:49:41.736359+0000","last_undegraded":"2024-09-21T01:49:41.736359+0000","last_fullsized":"2024-09-21T01:49:41.736359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:24.593410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736268+0000","last_change":"2024-09-21T01:49:40.369575+0000","last_active":"2024-09-21T01:49:41.736268+0000","last_peered":"2024-09-21T01:49:41.736268+0000","last_clean":"2024-09-21T01:49:41.736268+0000","last_became_active":"2024-09-21T01:49:40.369160+0000","last_became_peered":"2024-09-21T01:49:40.369160+0000","last_unstale":"2024-09-21T01:49:41.736268+0000","last_undegraded":"2024-09-21T01:49:41.736268+0000","last_fullsized":"2024-09-21T01:49:41.736268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:32.326084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736560+0000","last_change":"2024-09-21T01:49:40.354384+0000","last_active":"2024-09-21T01:49:41.736560+0000","last_peered":"2024-09-21T01:49:41.736560+0000","last_clean":"2024-09-21T01:49:41.736560+0000","last_became_active":"2024-09-21T01:49:40.354065+0000","last_became_peered":"2024-09-21T01:49:40.354065+0000","last_unstale":"2024-09-21T01:49:41.736560+0000","last_undegraded":"2024-09-21T01:49:41.736560+0000","last_fullsized":"2024-09-21T01:49:41.736560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:43.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735902+0000","last_change":"2024-09-21T01:49:40.365077+0000","last_active":"2024-09-21T01:49:41.735902+0000","last_peered":"2024-09-21T01:49:41.735902+0000","last_clean":"2024-09-21T01:49:41.735902+0000","last_became_active":"2024-09-21T01:49:40.364475+0000","last_became_peered":"2024-09-21T01:49:40.364475+0000","last_unstale":"2024-09-21T01:49:41.735902+0000","last_undegraded":"2024-09-21T01:49:41.735902+0000","last_fullsized":"2024-09-21T01:49:41.735902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:16.394801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332681+0000","last_change":"2024-09-21T01:49:38.332681+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332681+0000","last_undegraded":"2024-09-21T01:49:38.332681+0000","last_fullsized":"2024-09-21T01:49:38.332681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334373+0000","last_change":"2024-09-21T01:49:38.334373+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334373+0000","last_undegraded":"2024-09-21T01:49:38.334373+0000","last_fullsized":"2024-09-21T01:49:38.334373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332887+0000","last_change":"2024-09-21T01:49:38.332887+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332887+0000","last_undegraded":"2024-09-21T01:49:38.332887+0000","last_fullsized":"2024-09-21T01:49:38.332887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.335957+0000","last_change":"2024-09-21T01:49:38.335957+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.335957+0000","last_undegraded":"2024-09-21T01:49:38.335957+0000","last_fullsized":"2024-09-21T01:49:38.335957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736125+0000","last_change":"2024-09-21T01:49:40.352449+0000","last_active":"2024-09-21T01:49:41.736125+0000","last_peered":"2024-09-21T01:49:41.736125+0000","last_clean":"2024-09-21T01:49:41.736125+0000","last_became_active":"2024-09-21T01:49:40.352149+0000","last_became_peered":"2024-09-21T01:49:40.352149+0000","last_unstale":"2024-09-21T01:49:41.736125+0000","last_undegraded":"2024-09-21T01:49:41.736125+0000","last_fullsized":"2024-09-21T01:49:41.736125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:11.903566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.335396+0000","last_change":"2024-09-21T01:49:38.335396+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.335396+0000","last_undegraded":"2024-09-21T01:49:38.335396+0000","last_fullsized":"2024-09-21T01:49:38.335396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.337226+0000","last_change":"2024-09-21T01:49:38.337226+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.337226+0000","last_undegraded":"2024-09-21T01:49:38.337226+0000","last_fullsized":"2024-09-21T01:49:38.337226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736394+0000","last_change":"2024-09-21T01:49:39.354177+0000","last_active":"2024-09-21T01:49:41.736394+0000","last_peered":"2024-09-21T01:49:41.736394+0000","last_clean":"2024-09-21T01:49:41.736394+0000","last_became_active":"2024-09-21T01:49:39.353830+0000","last_became_peered":"2024-09-21T01:49:39.353830+0000","last_unstale":"2024-09-21T01:49:41.736394+0000","last_undegraded":"2024-09-21T01:49:41.736394+0000","last_fullsized":"2024-09-21T01:49:41.736394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:15.388595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334460+0000","last_change":"2024-09-21T01:49:38.334460+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334460+0000","last_undegraded":"2024-09-21T01:49:38.334460+0000","last_fullsized":"2024-09-21T01:49:38.334460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334068+0000","last_change":"2024-09-21T01:49:38.334068+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334068+0000","last_undegraded":"2024-09-21T01:49:38.334068+0000","last_fullsized":"2024-09-21T01:49:38.334068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.337601+0000","last_change":"2024-09-21T01:49:38.337601+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.337601+0000","last_undegraded":"2024-09-21T01:49:38.337601+0000","last_fullsized":"2024-09-21T01:49:38.337601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334806+0000","last_change":"2024-09-21T01:49:38.334806+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334806+0000","last_undegraded":"2024-09-21T01:49:38.334806+0000","last_fullsized":"2024-09-21T01:49:38.334806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735791+0000","last_change":"2024-09-21T01:49:39.352951+0000","last_active":"2024-09-21T01:49:41.735791+0000","last_peered":"2024-09-21T01:49:41.735791+0000","last_clean":"2024-09-21T01:49:41.735791+0000","last_became_active":"2024-09-21T01:49:39.352592+0000","last_became_peered":"2024-09-21T01:49:39.352592+0000","last_unstale":"2024-09-21T01:49:41.735791+0000","last_undegraded":"2024-09-21T01:49:41.735791+0000","last_fullsized":"2024-09-21T01:49:41.735791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:21.017265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334791+0000","last_change":"2024-09-21T01:49:38.334791+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334791+0000","last_undegraded":"2024-09-21T01:49:38.334791+0000","last_fullsized":"2024-09-21T01:49:38.334791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736424+0000","last_change":"2024-09-21T01:49:39.346299+0000","last_active":"2024-09-21T01:49:41.736424+0000","last_peered":"2024-09-21T01:49:41.736424+0000","last_clean":"2024-09-21T01:49:41.736424+0000","last_became_active":"2024-09-21T01:49:39.345944+0000","last_became_peered":"2024-09-21T01:49:39.345944+0000","last_unstale":"2024-09-21T01:49:41.736424+0000","last_undegraded":"2024-09-21T01:49:41.736424+0000","last_fullsized":"2024-09-21T01:49:41.736424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:19.582036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736525+0000","last_change":"2024-09-21T01:49:39.341903+0000","last_active":"2024-09-21T01:49:41.736525+0000","last_peered":"2024-09-21T01:49:41.736525+0000","last_clean":"2024-09-21T01:49:41.736525+0000","last_became_active":"2024-09-21T01:49:39.339820+0000","last_became_peered":"2024-09-21T01:49:39.339820+0000","last_unstale":"2024-09-21T01:49:41.736525+0000","last_undegraded":"2024-09-21T01:49:41.736525+0000","last_fullsized":"2024-09-21T01:49:41.736525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:09.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735984+0000","last_change":"2024-09-21T01:49:39.357807+0000","last_active":"2024-09-21T01:49:41.735984+0000","last_peered":"2024-09-21T01:49:41.735984+0000","last_clean":"2024-09-21T01:49:41.735984+0000","last_became_active":"2024-09-21T01:49:39.357452+0000","last_became_peered":"2024-09-21T01:49:39.357452+0000","last_unstale":"2024-09-21T01:49:41.735984+0000","last_undegraded":"2024-09-21T01:49:41.735984+0000","last_fullsized":"2024-09-21T01:49:41.735984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:13.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T01:49:38.334599+0000","last_change":"2024-09-21T01:49:29.995848+0000","last_active":"2024-09-21T01:49:38.334599+0000","last_peered":"2024-09-21T01:49:38.334599+0000","last_clean":"2024-09-21T01:49:38.334599+0000","last_became_active":"2024-09-21T01:49:29.994790+0000","last_became_peered":"2024-09-21T01:49:29.994790+0000","last_unstale":"2024-09-21T01:49:38.334599+0000","last_undegraded":"2024-09-21T01:49:38.334599+0000","last_fullsized":"2024-09-21T01:49:38.334599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_clean_scrub_stamp":"2024-09-21T01:49:28.252238+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:30.318506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.336739+0000","last_change":"2024-09-21T01:49:38.336739+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.336739+0000","last_undegraded":"2024-09-21T01:49:38.336739+0000","last_fullsized":"2024-09-21T01:49:38.336739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332637+0000","last_change":"2024-09-21T01:49:38.332637+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332637+0000","last_undegraded":"2024-09-21T01:49:38.332637+0000","last_fullsized":"2024-09-21T01:49:38.332637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736138+0000","last_change":"2024-09-21T01:49:39.346504+0000","last_active":"2024-09-21T01:49:41.736138+0000","last_peered":"2024-09-21T01:49:41.736138+0000","last_clean":"2024-09-21T01:49:41.736138+0000","last_became_active":"2024-09-21T01:49:39.345964+0000","last_became_peered":"2024-09-21T01:49:39.345964+0000","last_unstale":"2024-09-21T01:49:41.736138+0000","last_undegraded":"2024-09-21T01:49:41.736138+0000","last_fullsized":"2024-09-21T01:49:41.736138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736581+0000","last_change":"2024-09-21T01:49:40.355895+0000","last_active":"2024-09-21T01:49:41.736581+0000","last_peered":"2024-09-21T01:49:41.736581+0000","last_clean":"2024-09-21T01:49:41.736581+0000","last_became_active":"2024-09-21T01:49:40.355565+0000","last_became_peered":"2024-09-21T01:49:40.355565+0000","last_unstale":"2024-09-21T01:49:41.736581+0000","last_undegraded":"2024-09-21T01:49:41.736581+0000","last_fullsized":"2024-09-21T01:49:41.736581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:32.806782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.336796+0000","last_change":"2024-09-21T01:49:38.336796+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.336796+0000","last_undegraded":"2024-09-21T01:49:38.336796+0000","last_fullsized":"2024-09-21T01:49:38.336796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736502+0000","last_change":"2024-09-21T01:49:39.351127+0000","last_active":"2024-09-21T01:49:41.736502+0000","last_peered":"2024-09-21T01:49:41.736502+0000","last_clean":"2024-09-21T01:49:41.736502+0000","last_became_active":"2024-09-21T01:49:39.350783+0000","last_became_peered":"2024-09-21T01:49:39.350783+0000","last_unstale":"2024-09-21T01:49:41.736502+0000","last_undegraded":"2024-09-21T01:49:41.736502+0000","last_fullsized":"2024-09-21T01:49:41.736502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:42.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332889+0000","last_change":"2024-09-21T01:49:38.332889+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332889+0000","last_undegraded":"2024-09-21T01:49:38.332889+0000","last_fullsized":"2024-09-21T01:49:38.332889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736513+0000","last_change":"2024-09-21T01:49:40.351790+0000","last_active":"2024-09-21T01:49:41.736513+0000","last_peered":"2024-09-21T01:49:41.736513+0000","last_clean":"2024-09-21T01:49:41.736513+0000","last_became_active":"2024-09-21T01:49:40.351392+0000","last_became_peered":"2024-09-21T01:49:40.351392+0000","last_unstale":"2024-09-21T01:49:41.736513+0000","last_undegraded":"2024-09-21T01:49:41.736513+0000","last_fullsized":"2024-09-21T01:49:41.736513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:45.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:42.340972+0000","last_change":"2024-09-21T01:49:39.353294+0000","last_active":"2024-09-21T01:49:42.340972+0000","last_peered":"2024-09-21T01:49:42.340972+0000","last_clean":"2024-09-21T01:49:42.340972+0000","last_became_active":"2024-09-21T01:49:39.352984+0000","last_became_peered":"2024-09-21T01:49:39.352984+0000","last_unstale":"2024-09-21T01:49:42.340972+0000","last_undegraded":"2024-09-21T01:49:42.340972+0000","last_fullsized":"2024-09-21T01:49:42.340972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:31.319877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334420+0000","last_change":"2024-09-21T01:49:38.334420+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334420+0000","last_undegraded":"2024-09-21T01:49:38.334420+0000","last_fullsized":"2024-09-21T01:49:38.334420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.333317+0000","last_change":"2024-09-21T01:49:38.333317+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.333317+0000","last_undegraded":"2024-09-21T01:49:38.333317+0000","last_fullsized":"2024-09-21T01:49:38.333317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736277+0000","last_change":"2024-09-21T01:49:39.350179+0000","last_active":"2024-09-21T01:49:41.736277+0000","last_peered":"2024-09-21T01:49:41.736277+0000","last_clean":"2024-09-21T01:49:41.736277+0000","last_became_active":"2024-09-21T01:49:39.347968+0000","last_became_peered":"2024-09-21T01:49:39.347968+0000","last_unstale":"2024-09-21T01:49:41.736277+0000","last_undegraded":"2024-09-21T01:49:41.736277+0000","last_fullsized":"2024-09-21T01:49:41.736277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736233+0000","last_change":"2024-09-21T01:49:39.349158+0000","last_active":"2024-09-21T01:49:41.736233+0000","last_peered":"2024-09-21T01:49:41.736233+0000","last_clean":"2024-09-21T01:49:41.736233+0000","last_became_active":"2024-09-21T01:49:39.347821+0000","last_became_peered":"2024-09-21T01:49:39.347821+0000","last_unstale":"2024-09-21T01:49:41.736233+0000","last_undegraded":"2024-09-21T01:49:41.736233+0000","last_fullsized":"2024-09-21T01:49:41.736233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:02.187963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332663+0000","last_change":"2024-09-21T01:49:38.332663+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332663+0000","last_undegraded":"2024-09-21T01:49:38.332663+0000","last_fullsized":"2024-09-21T01:49:38.332663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332634+0000","last_change":"2024-09-21T01:49:38.332634+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332634+0000","last_undegraded":"2024-09-21T01:49:38.332634+0000","last_fullsized":"2024-09-21T01:49:38.332634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.333921+0000","last_change":"2024-09-21T01:49:38.333921+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.333921+0000","last_undegraded":"2024-09-21T01:49:38.333921+0000","last_fullsized":"2024-09-21T01:49:38.333921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332767+0000","last_change":"2024-09-21T01:49:38.332767+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332767+0000","last_undegraded":"2024-09-21T01:49:38.332767+0000","last_fullsized":"2024-09-21T01:49:38.332767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.333814+0000","last_change":"2024-09-21T01:49:38.333814+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.333814+0000","last_undegraded":"2024-09-21T01:49:38.333814+0000","last_fullsized":"2024-09-21T01:49:38.333814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":642985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":753664,"data_stored":637168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:49:44.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:49:44.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.570+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/3006452266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6680 msgr2=0x7f5c980b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.570+0000 7f5c9e0f9640 1 --2- 172.21.15.40:0/3006452266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6680 0x7f5c980b0de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5c88009820 tx=0x7f5c8802a510 comp rx=0 tx=0).stop 2024-09-21T01:49:44.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.570+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/3006452266 shutdown_connections 2024-09-21T01:49:44.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.570+0000 7f5c9e0f9640 1 --2- 172.21.15.40:0/3006452266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6680 0x7f5c980b0de0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.570+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/3006452266 >> 172.21.15.40:0/3006452266 conn(0x7f5c980d12a0 msgr2=0x7f5c980d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:44.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.570+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/3006452266 shutdown_connections 2024-09-21T01:49:44.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.570+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/3006452266 wait complete. 2024-09-21T01:49:44.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.572+0000 7f5c9e0f9640 1 Processor -- start 2024-09-21T01:49:44.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.572+0000 7f5c9e0f9640 1 -- start start 2024-09-21T01:49:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c9e0f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6100 0x7f5c980ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c9e0f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c980b6680 0x7f5c98163f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c9e0f9640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5c98162f60 0x7f5c981f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c9e0f9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5c98166c20 con 0x7f5c980b6100 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c9e0f9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5c98166aa0 con 0x7f5c980b6680 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c9e0f9640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f5c98166da0 con 0x7f5c98162f60 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c977fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6100 0x7f5c980ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c977fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6100 0x7f5c980ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50810/0 (socket says 172.21.15.40:50810) 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c977fe640 1 -- 172.21.15.40:0/1821284691 learned_addr learned my addr 172.21.15.40:0/1821284691 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c96ffd640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c980b6680 0x7f5c98163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c97fff640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5c98162f60 0x7f5c981f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c977fe640 1 -- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5c98162f60 msgr2=0x7f5c981f90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c977fe640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5c98162f60 0x7f5c981f90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c977fe640 1 -- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c980b6680 msgr2=0x7f5c98163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c977fe640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c980b6680 0x7f5c98163f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c977fe640 1 -- 172.21.15.40:0/1821284691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c98160ea0 con 0x7f5c980b6100 2024-09-21T01:49:44.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c977fe640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6100 0x7f5c980ca8a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5c88000c00 tx=0x7f5c88005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c7ffff640 1 -- 172.21.15.40:0/1821284691 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8803f070 con 0x7f5c980b6100 2024-09-21T01:49:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c7ffff640 1 -- 172.21.15.40:0/1821284691 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c88004340 con 0x7f5c980b6100 2024-09-21T01:49:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c980cade0 con 0x7f5c980b6100 2024-09-21T01:49:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.574+0000 7f5c7ffff640 1 -- 172.21.15.40:0/1821284691 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c88031bb0 con 0x7f5c980b6100 2024-09-21T01:49:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.575+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c980cbe20 con 0x7f5c980b6100 2024-09-21T01:49:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.575+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c980b0de0 con 0x7f5c980b6100 2024-09-21T01:49:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.576+0000 7f5c7ffff640 1 -- 172.21.15.40:0/1821284691 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c88042070 con 0x7f5c980b6100 2024-09-21T01:49:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.577+0000 7f5c7ffff640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5c84078bc0 0x7f5c8407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.577+0000 7f5c7ffff640 1 -- 172.21.15.40:0/1821284691 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5c880bbe20 con 0x7f5c980b6100 2024-09-21T01:49:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.577+0000 7f5c96ffd640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5c84078bc0 0x7f5c8407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.578+0000 7f5c96ffd640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5c84078bc0 0x7f5c8407b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c980ce900 tx=0x7f5c8c001a70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.582+0000 7f5c7ffff640 1 -- 172.21.15.40:0/1821284691 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5c88083c10 con 0x7f5c980b6100 2024-09-21T01:49:44.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.767+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 --> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c98071aa0 con 0x7f5c84078bc0 2024-09-21T01:49:44.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.771+0000 7f5c7ffff640 1 -- 172.21.15.40:0/1821284691 <== mgr.4100 v2:172.21.15.139:6800/852736644 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242254 (secure 0 0 0) 0x7f5c98071aa0 con 0x7f5c84078bc0 2024-09-21T01:49:44.774 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:44.775 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-21T01:49:44.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5c84078bc0 msgr2=0x7f5c8407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5c84078bc0 0x7f5c8407b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c980ce900 tx=0x7f5c8c001a70 comp rx=0 tx=0).stop 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6100 msgr2=0x7f5c980ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6100 0x7f5c980ca8a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5c88000c00 tx=0x7f5c88005360 comp rx=0 tx=0).stop 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 shutdown_connections 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5c84078bc0 0x7f5c8407b0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f5c98162f60 0x7f5c981f90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c980b6680 0x7f5c98163f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 --2- 172.21.15.40:0/1821284691 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c980b6100 0x7f5c980ca8a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 >> 172.21.15.40:0/1821284691 conn(0x7f5c980d12a0 msgr2=0x7f5c980d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 shutdown_connections 2024-09-21T01:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.774+0000 7f5c9e0f9640 1 -- 172.21.15.40:0/1821284691 wait complete. 2024-09-21T01:49:44.786 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T01:49:43.309551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218920,"kb_used_data":2572,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755800,"statfs":{"total":773094113280,"available":772869939200,"internally_reserved":0,"allocated":2633728,"data_stored":1634715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.979701"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736421+0000","last_change":"2024-09-21T01:49:40.366361+0000","last_active":"2024-09-21T01:49:41.736421+0000","last_peered":"2024-09-21T01:49:41.736421+0000","last_clean":"2024-09-21T01:49:41.736421+0000","last_became_active":"2024-09-21T01:49:40.366008+0000","last_became_peered":"2024-09-21T01:49:40.366008+0000","last_unstale":"2024-09-21T01:49:41.736421+0000","last_undegraded":"2024-09-21T01:49:41.736421+0000","last_fullsized":"2024-09-21T01:49:41.736421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:30.129619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736359+0000","last_change":"2024-09-21T01:49:40.364466+0000","last_active":"2024-09-21T01:49:41.736359+0000","last_peered":"2024-09-21T01:49:41.736359+0000","last_clean":"2024-09-21T01:49:41.736359+0000","last_became_active":"2024-09-21T01:49:40.364098+0000","last_became_peered":"2024-09-21T01:49:40.364098+0000","last_unstale":"2024-09-21T01:49:41.736359+0000","last_undegraded":"2024-09-21T01:49:41.736359+0000","last_fullsized":"2024-09-21T01:49:41.736359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:24.593410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736268+0000","last_change":"2024-09-21T01:49:40.369575+0000","last_active":"2024-09-21T01:49:41.736268+0000","last_peered":"2024-09-21T01:49:41.736268+0000","last_clean":"2024-09-21T01:49:41.736268+0000","last_became_active":"2024-09-21T01:49:40.369160+0000","last_became_peered":"2024-09-21T01:49:40.369160+0000","last_unstale":"2024-09-21T01:49:41.736268+0000","last_undegraded":"2024-09-21T01:49:41.736268+0000","last_fullsized":"2024-09-21T01:49:41.736268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:32.326084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736560+0000","last_change":"2024-09-21T01:49:40.354384+0000","last_active":"2024-09-21T01:49:41.736560+0000","last_peered":"2024-09-21T01:49:41.736560+0000","last_clean":"2024-09-21T01:49:41.736560+0000","last_became_active":"2024-09-21T01:49:40.354065+0000","last_became_peered":"2024-09-21T01:49:40.354065+0000","last_unstale":"2024-09-21T01:49:41.736560+0000","last_undegraded":"2024-09-21T01:49:41.736560+0000","last_fullsized":"2024-09-21T01:49:41.736560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:43.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735902+0000","last_change":"2024-09-21T01:49:40.365077+0000","last_active":"2024-09-21T01:49:41.735902+0000","last_peered":"2024-09-21T01:49:41.735902+0000","last_clean":"2024-09-21T01:49:41.735902+0000","last_became_active":"2024-09-21T01:49:40.364475+0000","last_became_peered":"2024-09-21T01:49:40.364475+0000","last_unstale":"2024-09-21T01:49:41.735902+0000","last_undegraded":"2024-09-21T01:49:41.735902+0000","last_fullsized":"2024-09-21T01:49:41.735902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:16.394801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332681+0000","last_change":"2024-09-21T01:49:38.332681+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332681+0000","last_undegraded":"2024-09-21T01:49:38.332681+0000","last_fullsized":"2024-09-21T01:49:38.332681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334373+0000","last_change":"2024-09-21T01:49:38.334373+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334373+0000","last_undegraded":"2024-09-21T01:49:38.334373+0000","last_fullsized":"2024-09-21T01:49:38.334373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332887+0000","last_change":"2024-09-21T01:49:38.332887+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332887+0000","last_undegraded":"2024-09-21T01:49:38.332887+0000","last_fullsized":"2024-09-21T01:49:38.332887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.335957+0000","last_change":"2024-09-21T01:49:38.335957+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.335957+0000","last_undegraded":"2024-09-21T01:49:38.335957+0000","last_fullsized":"2024-09-21T01:49:38.335957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736125+0000","last_change":"2024-09-21T01:49:40.352449+0000","last_active":"2024-09-21T01:49:41.736125+0000","last_peered":"2024-09-21T01:49:41.736125+0000","last_clean":"2024-09-21T01:49:41.736125+0000","last_became_active":"2024-09-21T01:49:40.352149+0000","last_became_peered":"2024-09-21T01:49:40.352149+0000","last_unstale":"2024-09-21T01:49:41.736125+0000","last_undegraded":"2024-09-21T01:49:41.736125+0000","last_fullsized":"2024-09-21T01:49:41.736125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:11.903566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.335396+0000","last_change":"2024-09-21T01:49:38.335396+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.335396+0000","last_undegraded":"2024-09-21T01:49:38.335396+0000","last_fullsized":"2024-09-21T01:49:38.335396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.337226+0000","last_change":"2024-09-21T01:49:38.337226+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.337226+0000","last_undegraded":"2024-09-21T01:49:38.337226+0000","last_fullsized":"2024-09-21T01:49:38.337226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736394+0000","last_change":"2024-09-21T01:49:39.354177+0000","last_active":"2024-09-21T01:49:41.736394+0000","last_peered":"2024-09-21T01:49:41.736394+0000","last_clean":"2024-09-21T01:49:41.736394+0000","last_became_active":"2024-09-21T01:49:39.353830+0000","last_became_peered":"2024-09-21T01:49:39.353830+0000","last_unstale":"2024-09-21T01:49:41.736394+0000","last_undegraded":"2024-09-21T01:49:41.736394+0000","last_fullsized":"2024-09-21T01:49:41.736394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:15.388595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334460+0000","last_change":"2024-09-21T01:49:38.334460+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334460+0000","last_undegraded":"2024-09-21T01:49:38.334460+0000","last_fullsized":"2024-09-21T01:49:38.334460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334068+0000","last_change":"2024-09-21T01:49:38.334068+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334068+0000","last_undegraded":"2024-09-21T01:49:38.334068+0000","last_fullsized":"2024-09-21T01:49:38.334068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.337601+0000","last_change":"2024-09-21T01:49:38.337601+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.337601+0000","last_undegraded":"2024-09-21T01:49:38.337601+0000","last_fullsized":"2024-09-21T01:49:38.337601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334806+0000","last_change":"2024-09-21T01:49:38.334806+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334806+0000","last_undegraded":"2024-09-21T01:49:38.334806+0000","last_fullsized":"2024-09-21T01:49:38.334806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735791+0000","last_change":"2024-09-21T01:49:39.352951+0000","last_active":"2024-09-21T01:49:41.735791+0000","last_peered":"2024-09-21T01:49:41.735791+0000","last_clean":"2024-09-21T01:49:41.735791+0000","last_became_active":"2024-09-21T01:49:39.352592+0000","last_became_peered":"2024-09-21T01:49:39.352592+0000","last_unstale":"2024-09-21T01:49:41.735791+0000","last_undegraded":"2024-09-21T01:49:41.735791+0000","last_fullsized":"2024-09-21T01:49:41.735791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:21.017265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334791+0000","last_change":"2024-09-21T01:49:38.334791+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334791+0000","last_undegraded":"2024-09-21T01:49:38.334791+0000","last_fullsized":"2024-09-21T01:49:38.334791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736424+0000","last_change":"2024-09-21T01:49:39.346299+0000","last_active":"2024-09-21T01:49:41.736424+0000","last_peered":"2024-09-21T01:49:41.736424+0000","last_clean":"2024-09-21T01:49:41.736424+0000","last_became_active":"2024-09-21T01:49:39.345944+0000","last_became_peered":"2024-09-21T01:49:39.345944+0000","last_unstale":"2024-09-21T01:49:41.736424+0000","last_undegraded":"2024-09-21T01:49:41.736424+0000","last_fullsized":"2024-09-21T01:49:41.736424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:19.582036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736525+0000","last_change":"2024-09-21T01:49:39.341903+0000","last_active":"2024-09-21T01:49:41.736525+0000","last_peered":"2024-09-21T01:49:41.736525+0000","last_clean":"2024-09-21T01:49:41.736525+0000","last_became_active":"2024-09-21T01:49:39.339820+0000","last_became_peered":"2024-09-21T01:49:39.339820+0000","last_unstale":"2024-09-21T01:49:41.736525+0000","last_undegraded":"2024-09-21T01:49:41.736525+0000","last_fullsized":"2024-09-21T01:49:41.736525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:09.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735984+0000","last_change":"2024-09-21T01:49:39.357807+0000","last_active":"2024-09-21T01:49:41.735984+0000","last_peered":"2024-09-21T01:49:41.735984+0000","last_clean":"2024-09-21T01:49:41.735984+0000","last_became_active":"2024-09-21T01:49:39.357452+0000","last_became_peered":"2024-09-21T01:49:39.357452+0000","last_unstale":"2024-09-21T01:49:41.735984+0000","last_undegraded":"2024-09-21T01:49:41.735984+0000","last_fullsized":"2024-09-21T01:49:41.735984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:13.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T01:49:38.334599+0000","last_change":"2024-09-21T01:49:29.995848+0000","last_active":"2024-09-21T01:49:38.334599+0000","last_peered":"2024-09-21T01:49:38.334599+0000","last_clean":"2024-09-21T01:49:38.334599+0000","last_became_active":"2024-09-21T01:49:29.994790+0000","last_became_peered":"2024-09-21T01:49:29.994790+0000","last_unstale":"2024-09-21T01:49:38.334599+0000","last_undegraded":"2024-09-21T01:49:38.334599+0000","last_fullsized":"2024-09-21T01:49:38.334599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_clean_scrub_stamp":"2024-09-21T01:49:28.252238+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:30.318506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.336739+0000","last_change":"2024-09-21T01:49:38.336739+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.336739+0000","last_undegraded":"2024-09-21T01:49:38.336739+0000","last_fullsized":"2024-09-21T01:49:38.336739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332637+0000","last_change":"2024-09-21T01:49:38.332637+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332637+0000","last_undegraded":"2024-09-21T01:49:38.332637+0000","last_fullsized":"2024-09-21T01:49:38.332637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736138+0000","last_change":"2024-09-21T01:49:39.346504+0000","last_active":"2024-09-21T01:49:41.736138+0000","last_peered":"2024-09-21T01:49:41.736138+0000","last_clean":"2024-09-21T01:49:41.736138+0000","last_became_active":"2024-09-21T01:49:39.345964+0000","last_became_peered":"2024-09-21T01:49:39.345964+0000","last_unstale":"2024-09-21T01:49:41.736138+0000","last_undegraded":"2024-09-21T01:49:41.736138+0000","last_fullsized":"2024-09-21T01:49:41.736138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736581+0000","last_change":"2024-09-21T01:49:40.355895+0000","last_active":"2024-09-21T01:49:41.736581+0000","last_peered":"2024-09-21T01:49:41.736581+0000","last_clean":"2024-09-21T01:49:41.736581+0000","last_became_active":"2024-09-21T01:49:40.355565+0000","last_became_peered":"2024-09-21T01:49:40.355565+0000","last_unstale":"2024-09-21T01:49:41.736581+0000","last_undegraded":"2024-09-21T01:49:41.736581+0000","last_fullsized":"2024-09-21T01:49:41.736581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:32.806782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.336796+0000","last_change":"2024-09-21T01:49:38.336796+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.336796+0000","last_undegraded":"2024-09-21T01:49:38.336796+0000","last_fullsized":"2024-09-21T01:49:38.336796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736502+0000","last_change":"2024-09-21T01:49:39.351127+0000","last_active":"2024-09-21T01:49:41.736502+0000","last_peered":"2024-09-21T01:49:41.736502+0000","last_clean":"2024-09-21T01:49:41.736502+0000","last_became_active":"2024-09-21T01:49:39.350783+0000","last_became_peered":"2024-09-21T01:49:39.350783+0000","last_unstale":"2024-09-21T01:49:41.736502+0000","last_undegraded":"2024-09-21T01:49:41.736502+0000","last_fullsized":"2024-09-21T01:49:41.736502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:42.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332889+0000","last_change":"2024-09-21T01:49:38.332889+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332889+0000","last_undegraded":"2024-09-21T01:49:38.332889+0000","last_fullsized":"2024-09-21T01:49:38.332889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736513+0000","last_change":"2024-09-21T01:49:40.351790+0000","last_active":"2024-09-21T01:49:41.736513+0000","last_peered":"2024-09-21T01:49:41.736513+0000","last_clean":"2024-09-21T01:49:41.736513+0000","last_became_active":"2024-09-21T01:49:40.351392+0000","last_became_peered":"2024-09-21T01:49:40.351392+0000","last_unstale":"2024-09-21T01:49:41.736513+0000","last_undegraded":"2024-09-21T01:49:41.736513+0000","last_fullsized":"2024-09-21T01:49:41.736513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:45.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:42.340972+0000","last_change":"2024-09-21T01:49:39.353294+0000","last_active":"2024-09-21T01:49:42.340972+0000","last_peered":"2024-09-21T01:49:42.340972+0000","last_clean":"2024-09-21T01:49:42.340972+0000","last_became_active":"2024-09-21T01:49:39.352984+0000","last_became_peered":"2024-09-21T01:49:39.352984+0000","last_unstale":"2024-09-21T01:49:42.340972+0000","last_undegraded":"2024-09-21T01:49:42.340972+0000","last_fullsized":"2024-09-21T01:49:42.340972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:31.319877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334420+0000","last_change":"2024-09-21T01:49:38.334420+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334420+0000","last_undegraded":"2024-09-21T01:49:38.334420+0000","last_fullsized":"2024-09-21T01:49:38.334420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.333317+0000","last_change":"2024-09-21T01:49:38.333317+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.333317+0000","last_undegraded":"2024-09-21T01:49:38.333317+0000","last_fullsized":"2024-09-21T01:49:38.333317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736277+0000","last_change":"2024-09-21T01:49:39.350179+0000","last_active":"2024-09-21T01:49:41.736277+0000","last_peered":"2024-09-21T01:49:41.736277+0000","last_clean":"2024-09-21T01:49:41.736277+0000","last_became_active":"2024-09-21T01:49:39.347968+0000","last_became_peered":"2024-09-21T01:49:39.347968+0000","last_unstale":"2024-09-21T01:49:41.736277+0000","last_undegraded":"2024-09-21T01:49:41.736277+0000","last_fullsized":"2024-09-21T01:49:41.736277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736233+0000","last_change":"2024-09-21T01:49:39.349158+0000","last_active":"2024-09-21T01:49:41.736233+0000","last_peered":"2024-09-21T01:49:41.736233+0000","last_clean":"2024-09-21T01:49:41.736233+0000","last_became_active":"2024-09-21T01:49:39.347821+0000","last_became_peered":"2024-09-21T01:49:39.347821+0000","last_unstale":"2024-09-21T01:49:41.736233+0000","last_undegraded":"2024-09-21T01:49:41.736233+0000","last_fullsized":"2024-09-21T01:49:41.736233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:02.187963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332663+0000","last_change":"2024-09-21T01:49:38.332663+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332663+0000","last_undegraded":"2024-09-21T01:49:38.332663+0000","last_fullsized":"2024-09-21T01:49:38.332663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332634+0000","last_change":"2024-09-21T01:49:38.332634+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332634+0000","last_undegraded":"2024-09-21T01:49:38.332634+0000","last_fullsized":"2024-09-21T01:49:38.332634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.333921+0000","last_change":"2024-09-21T01:49:38.333921+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.333921+0000","last_undegraded":"2024-09-21T01:49:38.333921+0000","last_fullsized":"2024-09-21T01:49:38.333921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332767+0000","last_change":"2024-09-21T01:49:38.332767+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332767+0000","last_undegraded":"2024-09-21T01:49:38.332767+0000","last_fullsized":"2024-09-21T01:49:38.332767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.333814+0000","last_change":"2024-09-21T01:49:38.333814+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.333814+0000","last_undegraded":"2024-09-21T01:49:38.333814+0000","last_fullsized":"2024-09-21T01:49:38.333814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":642985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":753664,"data_stored":637168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:49:44.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:49:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.942+0000 7f8fd8139640 1 -- 172.21.15.40:0/3035587071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006e170 msgr2=0x7f8fd00b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.942+0000 7f8fd8139640 1 --2- 172.21.15.40:0/3035587071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006e170 0x7f8fd00b3540 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00ba090 tx=0x7f8fc002a5a0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.942+0000 7f8fd8139640 1 -- 172.21.15.40:0/3035587071 shutdown_connections 2024-09-21T01:49:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.942+0000 7f8fd8139640 1 --2- 172.21.15.40:0/3035587071 >> v2:172.21.15.139:3300/0 conn(0x7f8fd00ceb40 0x7f8fd00cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.942+0000 7f8fd8139640 1 --2- 172.21.15.40:0/3035587071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006e170 0x7f8fd00b3540 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.942+0000 7f8fd8139640 1 -- 172.21.15.40:0/3035587071 >> 172.21.15.40:0/3035587071 conn(0x7f8fd008bfc0 msgr2=0x7f8fd009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.942+0000 7f8fd8139640 1 -- 172.21.15.40:0/3035587071 shutdown_connections 2024-09-21T01:49:44.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.942+0000 7f8fd8139640 1 -- 172.21.15.40:0/3035587071 wait complete. 2024-09-21T01:49:44.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.944+0000 7f8fd8139640 1 Processor -- start 2024-09-21T01:49:44.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.944+0000 7f8fd8139640 1 -- start start 2024-09-21T01:49:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd8139640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006f4b0 0x7f8fd015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd8139640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00ceb40 0x7f8fd00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd8139640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00b54f0 0x7f8fd00b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd8139640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd00d0e60 con 0x7f8fd006f4b0 2024-09-21T01:49:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd8139640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd00d0ce0 con 0x7f8fd00ceb40 2024-09-21T01:49:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd8139640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd00d0fe0 con 0x7f8fd00b54f0 2024-09-21T01:49:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd5ed5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006f4b0 0x7f8fd015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd5ed5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006f4b0 0x7f8fd015da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50826/0 (socket says 172.21.15.40:50826) 2024-09-21T01:49:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd5ed5640 1 -- 172.21.15.40:0/3221123193 learned_addr learned my addr 172.21.15.40:0/3221123193 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd66d6640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00b54f0 0x7f8fd00b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.945+0000 7f8fd56d4640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00ceb40 0x7f8fd00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fd5ed5640 1 -- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00b54f0 msgr2=0x7f8fd00b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fd5ed5640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00b54f0 0x7f8fd00b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fd5ed5640 1 -- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00ceb40 msgr2=0x7f8fd00cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fd5ed5640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00ceb40 0x7f8fd00cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fd5ed5640 1 -- 172.21.15.40:0/3221123193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd00b5e40 con 0x7f8fd006f4b0 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fd56d4640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00ceb40 0x7f8fd00cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fd5ed5640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006f4b0 0x7f8fd015da00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0000c00 tx=0x7f8fc0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fc67fc640 1 -- 172.21.15.40:0/3221123193 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc003e030 con 0x7f8fd006f4b0 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fc67fc640 1 -- 172.21.15.40:0/3221123193 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fc0003e00 con 0x7f8fd006f4b0 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd00cc890 con 0x7f8fd006f4b0 2024-09-21T01:49:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fc67fc640 1 -- 172.21.15.40:0/3221123193 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0035040 con 0x7f8fd006f4b0 2024-09-21T01:49:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.946+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd01f8f90 con 0x7f8fd006f4b0 2024-09-21T01:49:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.947+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd00d1510 con 0x7f8fd006f4b0 2024-09-21T01:49:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.948+0000 7f8fc67fc640 1 -- 172.21.15.40:0/3221123193 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8fc0041030 con 0x7f8fd006f4b0 2024-09-21T01:49:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.948+0000 7f8fc67fc640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8fb4078b90 0x7f8fb407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.948+0000 7f8fc67fc640 1 -- 172.21.15.40:0/3221123193 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8fc00bb3c0 con 0x7f8fd006f4b0 2024-09-21T01:49:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.949+0000 7f8fd56d4640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8fb4078b90 0x7f8fb407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:44.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.949+0000 7f8fd56d4640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8fb4078b90 0x7f8fb407b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc007fd0 tx=0x7f8fcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:44.953+0000 7f8fc67fc640 1 -- 172.21.15.40:0/3221123193 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8fd00b5e40 con 0x7f8fd006f4b0 2024-09-21T01:49:45.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.137+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 --> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fd006ef10 con 0x7f8fb4078b90 2024-09-21T01:49:45.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.142+0000 7f8fc67fc640 1 -- 172.21.15.40:0/3221123193 <== mgr.4100 v2:172.21.15.139:6800/852736644 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242254 (secure 0 0 0) 0x7f8fd006ef10 con 0x7f8fb4078b90 2024-09-21T01:49:45.145 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:45.145 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-21T01:49:45.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8fb4078b90 msgr2=0x7f8fb407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8fb4078b90 0x7f8fb407b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc007fd0 tx=0x7f8fcc009040 comp rx=0 tx=0).stop 2024-09-21T01:49:45.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006f4b0 msgr2=0x7f8fd015da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006f4b0 0x7f8fd015da00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0000c00 tx=0x7f8fc0003910 comp rx=0 tx=0).stop 2024-09-21T01:49:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 shutdown_connections 2024-09-21T01:49:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8fb4078b90 0x7f8fb407b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8fd00b54f0 0x7f8fd00b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fd00ceb40 0x7f8fd00cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 --2- 172.21.15.40:0/3221123193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd006f4b0 0x7f8fd015da00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 >> 172.21.15.40:0/3221123193 conn(0x7f8fd008bfc0 msgr2=0x7f8fd0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 shutdown_connections 2024-09-21T01:49:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.145+0000 7f8fd8139640 1 -- 172.21.15.40:0/3221123193 wait complete. 2024-09-21T01:49:45.157 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T01:49:43.309551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":122,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218920,"kb_used_data":2572,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755800,"statfs":{"total":773094113280,"available":772869939200,"internally_reserved":0,"allocated":2633728,"data_stored":1634715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.979701"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736421+0000","last_change":"2024-09-21T01:49:40.366361+0000","last_active":"2024-09-21T01:49:41.736421+0000","last_peered":"2024-09-21T01:49:41.736421+0000","last_clean":"2024-09-21T01:49:41.736421+0000","last_became_active":"2024-09-21T01:49:40.366008+0000","last_became_peered":"2024-09-21T01:49:40.366008+0000","last_unstale":"2024-09-21T01:49:41.736421+0000","last_undegraded":"2024-09-21T01:49:41.736421+0000","last_fullsized":"2024-09-21T01:49:41.736421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:30.129619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736359+0000","last_change":"2024-09-21T01:49:40.364466+0000","last_active":"2024-09-21T01:49:41.736359+0000","last_peered":"2024-09-21T01:49:41.736359+0000","last_clean":"2024-09-21T01:49:41.736359+0000","last_became_active":"2024-09-21T01:49:40.364098+0000","last_became_peered":"2024-09-21T01:49:40.364098+0000","last_unstale":"2024-09-21T01:49:41.736359+0000","last_undegraded":"2024-09-21T01:49:41.736359+0000","last_fullsized":"2024-09-21T01:49:41.736359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:24.593410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736268+0000","last_change":"2024-09-21T01:49:40.369575+0000","last_active":"2024-09-21T01:49:41.736268+0000","last_peered":"2024-09-21T01:49:41.736268+0000","last_clean":"2024-09-21T01:49:41.736268+0000","last_became_active":"2024-09-21T01:49:40.369160+0000","last_became_peered":"2024-09-21T01:49:40.369160+0000","last_unstale":"2024-09-21T01:49:41.736268+0000","last_undegraded":"2024-09-21T01:49:41.736268+0000","last_fullsized":"2024-09-21T01:49:41.736268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:32.326084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736560+0000","last_change":"2024-09-21T01:49:40.354384+0000","last_active":"2024-09-21T01:49:41.736560+0000","last_peered":"2024-09-21T01:49:41.736560+0000","last_clean":"2024-09-21T01:49:41.736560+0000","last_became_active":"2024-09-21T01:49:40.354065+0000","last_became_peered":"2024-09-21T01:49:40.354065+0000","last_unstale":"2024-09-21T01:49:41.736560+0000","last_undegraded":"2024-09-21T01:49:41.736560+0000","last_fullsized":"2024-09-21T01:49:41.736560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:43.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735902+0000","last_change":"2024-09-21T01:49:40.365077+0000","last_active":"2024-09-21T01:49:41.735902+0000","last_peered":"2024-09-21T01:49:41.735902+0000","last_clean":"2024-09-21T01:49:41.735902+0000","last_became_active":"2024-09-21T01:49:40.364475+0000","last_became_peered":"2024-09-21T01:49:40.364475+0000","last_unstale":"2024-09-21T01:49:41.735902+0000","last_undegraded":"2024-09-21T01:49:41.735902+0000","last_fullsized":"2024-09-21T01:49:41.735902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:16.394801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332681+0000","last_change":"2024-09-21T01:49:38.332681+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332681+0000","last_undegraded":"2024-09-21T01:49:38.332681+0000","last_fullsized":"2024-09-21T01:49:38.332681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334373+0000","last_change":"2024-09-21T01:49:38.334373+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334373+0000","last_undegraded":"2024-09-21T01:49:38.334373+0000","last_fullsized":"2024-09-21T01:49:38.334373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332887+0000","last_change":"2024-09-21T01:49:38.332887+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332887+0000","last_undegraded":"2024-09-21T01:49:38.332887+0000","last_fullsized":"2024-09-21T01:49:38.332887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.335957+0000","last_change":"2024-09-21T01:49:38.335957+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.335957+0000","last_undegraded":"2024-09-21T01:49:38.335957+0000","last_fullsized":"2024-09-21T01:49:38.335957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736125+0000","last_change":"2024-09-21T01:49:40.352449+0000","last_active":"2024-09-21T01:49:41.736125+0000","last_peered":"2024-09-21T01:49:41.736125+0000","last_clean":"2024-09-21T01:49:41.736125+0000","last_became_active":"2024-09-21T01:49:40.352149+0000","last_became_peered":"2024-09-21T01:49:40.352149+0000","last_unstale":"2024-09-21T01:49:41.736125+0000","last_undegraded":"2024-09-21T01:49:41.736125+0000","last_fullsized":"2024-09-21T01:49:41.736125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:11.903566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.335396+0000","last_change":"2024-09-21T01:49:38.335396+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.335396+0000","last_undegraded":"2024-09-21T01:49:38.335396+0000","last_fullsized":"2024-09-21T01:49:38.335396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.337226+0000","last_change":"2024-09-21T01:49:38.337226+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.337226+0000","last_undegraded":"2024-09-21T01:49:38.337226+0000","last_fullsized":"2024-09-21T01:49:38.337226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736394+0000","last_change":"2024-09-21T01:49:39.354177+0000","last_active":"2024-09-21T01:49:41.736394+0000","last_peered":"2024-09-21T01:49:41.736394+0000","last_clean":"2024-09-21T01:49:41.736394+0000","last_became_active":"2024-09-21T01:49:39.353830+0000","last_became_peered":"2024-09-21T01:49:39.353830+0000","last_unstale":"2024-09-21T01:49:41.736394+0000","last_undegraded":"2024-09-21T01:49:41.736394+0000","last_fullsized":"2024-09-21T01:49:41.736394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:15.388595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334460+0000","last_change":"2024-09-21T01:49:38.334460+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334460+0000","last_undegraded":"2024-09-21T01:49:38.334460+0000","last_fullsized":"2024-09-21T01:49:38.334460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334068+0000","last_change":"2024-09-21T01:49:38.334068+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334068+0000","last_undegraded":"2024-09-21T01:49:38.334068+0000","last_fullsized":"2024-09-21T01:49:38.334068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.337601+0000","last_change":"2024-09-21T01:49:38.337601+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.337601+0000","last_undegraded":"2024-09-21T01:49:38.337601+0000","last_fullsized":"2024-09-21T01:49:38.337601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334806+0000","last_change":"2024-09-21T01:49:38.334806+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334806+0000","last_undegraded":"2024-09-21T01:49:38.334806+0000","last_fullsized":"2024-09-21T01:49:38.334806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735791+0000","last_change":"2024-09-21T01:49:39.352951+0000","last_active":"2024-09-21T01:49:41.735791+0000","last_peered":"2024-09-21T01:49:41.735791+0000","last_clean":"2024-09-21T01:49:41.735791+0000","last_became_active":"2024-09-21T01:49:39.352592+0000","last_became_peered":"2024-09-21T01:49:39.352592+0000","last_unstale":"2024-09-21T01:49:41.735791+0000","last_undegraded":"2024-09-21T01:49:41.735791+0000","last_fullsized":"2024-09-21T01:49:41.735791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:21.017265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334791+0000","last_change":"2024-09-21T01:49:38.334791+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334791+0000","last_undegraded":"2024-09-21T01:49:38.334791+0000","last_fullsized":"2024-09-21T01:49:38.334791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736424+0000","last_change":"2024-09-21T01:49:39.346299+0000","last_active":"2024-09-21T01:49:41.736424+0000","last_peered":"2024-09-21T01:49:41.736424+0000","last_clean":"2024-09-21T01:49:41.736424+0000","last_became_active":"2024-09-21T01:49:39.345944+0000","last_became_peered":"2024-09-21T01:49:39.345944+0000","last_unstale":"2024-09-21T01:49:41.736424+0000","last_undegraded":"2024-09-21T01:49:41.736424+0000","last_fullsized":"2024-09-21T01:49:41.736424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:19.582036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736525+0000","last_change":"2024-09-21T01:49:39.341903+0000","last_active":"2024-09-21T01:49:41.736525+0000","last_peered":"2024-09-21T01:49:41.736525+0000","last_clean":"2024-09-21T01:49:41.736525+0000","last_became_active":"2024-09-21T01:49:39.339820+0000","last_became_peered":"2024-09-21T01:49:39.339820+0000","last_unstale":"2024-09-21T01:49:41.736525+0000","last_undegraded":"2024-09-21T01:49:41.736525+0000","last_fullsized":"2024-09-21T01:49:41.736525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:09.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735984+0000","last_change":"2024-09-21T01:49:39.357807+0000","last_active":"2024-09-21T01:49:41.735984+0000","last_peered":"2024-09-21T01:49:41.735984+0000","last_clean":"2024-09-21T01:49:41.735984+0000","last_became_active":"2024-09-21T01:49:39.357452+0000","last_became_peered":"2024-09-21T01:49:39.357452+0000","last_unstale":"2024-09-21T01:49:41.735984+0000","last_undegraded":"2024-09-21T01:49:41.735984+0000","last_fullsized":"2024-09-21T01:49:41.735984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:13.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-21T01:49:38.334599+0000","last_change":"2024-09-21T01:49:29.995848+0000","last_active":"2024-09-21T01:49:38.334599+0000","last_peered":"2024-09-21T01:49:38.334599+0000","last_clean":"2024-09-21T01:49:38.334599+0000","last_became_active":"2024-09-21T01:49:29.994790+0000","last_became_peered":"2024-09-21T01:49:29.994790+0000","last_unstale":"2024-09-21T01:49:38.334599+0000","last_undegraded":"2024-09-21T01:49:38.334599+0000","last_fullsized":"2024-09-21T01:49:38.334599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_clean_scrub_stamp":"2024-09-21T01:49:28.252238+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:30.318506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.336739+0000","last_change":"2024-09-21T01:49:38.336739+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.336739+0000","last_undegraded":"2024-09-21T01:49:38.336739+0000","last_fullsized":"2024-09-21T01:49:38.336739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332637+0000","last_change":"2024-09-21T01:49:38.332637+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332637+0000","last_undegraded":"2024-09-21T01:49:38.332637+0000","last_fullsized":"2024-09-21T01:49:38.332637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736138+0000","last_change":"2024-09-21T01:49:39.346504+0000","last_active":"2024-09-21T01:49:41.736138+0000","last_peered":"2024-09-21T01:49:41.736138+0000","last_clean":"2024-09-21T01:49:41.736138+0000","last_became_active":"2024-09-21T01:49:39.345964+0000","last_became_peered":"2024-09-21T01:49:39.345964+0000","last_unstale":"2024-09-21T01:49:41.736138+0000","last_undegraded":"2024-09-21T01:49:41.736138+0000","last_fullsized":"2024-09-21T01:49:41.736138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736581+0000","last_change":"2024-09-21T01:49:40.355895+0000","last_active":"2024-09-21T01:49:41.736581+0000","last_peered":"2024-09-21T01:49:41.736581+0000","last_clean":"2024-09-21T01:49:41.736581+0000","last_became_active":"2024-09-21T01:49:40.355565+0000","last_became_peered":"2024-09-21T01:49:40.355565+0000","last_unstale":"2024-09-21T01:49:41.736581+0000","last_undegraded":"2024-09-21T01:49:41.736581+0000","last_fullsized":"2024-09-21T01:49:41.736581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:32.806782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.336796+0000","last_change":"2024-09-21T01:49:38.336796+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.336796+0000","last_undegraded":"2024-09-21T01:49:38.336796+0000","last_fullsized":"2024-09-21T01:49:38.336796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736502+0000","last_change":"2024-09-21T01:49:39.351127+0000","last_active":"2024-09-21T01:49:41.736502+0000","last_peered":"2024-09-21T01:49:41.736502+0000","last_clean":"2024-09-21T01:49:41.736502+0000","last_became_active":"2024-09-21T01:49:39.350783+0000","last_became_peered":"2024-09-21T01:49:39.350783+0000","last_unstale":"2024-09-21T01:49:41.736502+0000","last_undegraded":"2024-09-21T01:49:41.736502+0000","last_fullsized":"2024-09-21T01:49:41.736502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:42.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332889+0000","last_change":"2024-09-21T01:49:38.332889+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332889+0000","last_undegraded":"2024-09-21T01:49:38.332889+0000","last_fullsized":"2024-09-21T01:49:38.332889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736513+0000","last_change":"2024-09-21T01:49:40.351790+0000","last_active":"2024-09-21T01:49:41.736513+0000","last_peered":"2024-09-21T01:49:41.736513+0000","last_clean":"2024-09-21T01:49:41.736513+0000","last_became_active":"2024-09-21T01:49:40.351392+0000","last_became_peered":"2024-09-21T01:49:40.351392+0000","last_unstale":"2024-09-21T01:49:41.736513+0000","last_undegraded":"2024-09-21T01:49:41.736513+0000","last_fullsized":"2024-09-21T01:49:41.736513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:45.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:42.340972+0000","last_change":"2024-09-21T01:49:39.353294+0000","last_active":"2024-09-21T01:49:42.340972+0000","last_peered":"2024-09-21T01:49:42.340972+0000","last_clean":"2024-09-21T01:49:42.340972+0000","last_became_active":"2024-09-21T01:49:39.352984+0000","last_became_peered":"2024-09-21T01:49:39.352984+0000","last_unstale":"2024-09-21T01:49:42.340972+0000","last_undegraded":"2024-09-21T01:49:42.340972+0000","last_fullsized":"2024-09-21T01:49:42.340972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:31.319877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.334420+0000","last_change":"2024-09-21T01:49:38.334420+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.334420+0000","last_undegraded":"2024-09-21T01:49:38.334420+0000","last_fullsized":"2024-09-21T01:49:38.334420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.333317+0000","last_change":"2024-09-21T01:49:38.333317+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.333317+0000","last_undegraded":"2024-09-21T01:49:38.333317+0000","last_fullsized":"2024-09-21T01:49:38.333317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736277+0000","last_change":"2024-09-21T01:49:39.350179+0000","last_active":"2024-09-21T01:49:41.736277+0000","last_peered":"2024-09-21T01:49:41.736277+0000","last_clean":"2024-09-21T01:49:41.736277+0000","last_became_active":"2024-09-21T01:49:39.347968+0000","last_became_peered":"2024-09-21T01:49:39.347968+0000","last_unstale":"2024-09-21T01:49:41.736277+0000","last_undegraded":"2024-09-21T01:49:41.736277+0000","last_fullsized":"2024-09-21T01:49:41.736277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736233+0000","last_change":"2024-09-21T01:49:39.349158+0000","last_active":"2024-09-21T01:49:41.736233+0000","last_peered":"2024-09-21T01:49:41.736233+0000","last_clean":"2024-09-21T01:49:41.736233+0000","last_became_active":"2024-09-21T01:49:39.347821+0000","last_became_peered":"2024-09-21T01:49:39.347821+0000","last_unstale":"2024-09-21T01:49:41.736233+0000","last_undegraded":"2024-09-21T01:49:41.736233+0000","last_fullsized":"2024-09-21T01:49:41.736233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:02.187963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332663+0000","last_change":"2024-09-21T01:49:38.332663+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332663+0000","last_undegraded":"2024-09-21T01:49:38.332663+0000","last_fullsized":"2024-09-21T01:49:38.332663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332634+0000","last_change":"2024-09-21T01:49:38.332634+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332634+0000","last_undegraded":"2024-09-21T01:49:38.332634+0000","last_fullsized":"2024-09-21T01:49:38.332634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.333921+0000","last_change":"2024-09-21T01:49:38.333921+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.333921+0000","last_undegraded":"2024-09-21T01:49:38.333921+0000","last_fullsized":"2024-09-21T01:49:38.333921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.332767+0000","last_change":"2024-09-21T01:49:38.332767+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.332767+0000","last_undegraded":"2024-09-21T01:49:38.332767+0000","last_fullsized":"2024-09-21T01:49:38.332767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T01:49:39.326767+0000","last_change":"2024-09-21T01:49:39.326767+0000","last_active":"2024-09-21T01:49:39.326767+0000","last_peered":"2024-09-21T01:49:39.326767+0000","last_clean":"2024-09-21T01:49:39.326767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:39.326767+0000","last_undegraded":"2024-09-21T01:49:39.326767+0000","last_fullsized":"2024-09-21T01:49:39.326767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-21T01:49:38.333814+0000","last_change":"2024-09-21T01:49:38.333814+0000","last_active":"2024-09-21T01:49:38.320560+0000","last_peered":"2024-09-21T01:49:38.320560+0000","last_clean":"2024-09-21T01:49:38.320560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T01:49:38.333814+0000","last_undegraded":"2024-09-21T01:49:38.333814+0000","last_fullsized":"2024-09-21T01:49:38.333814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":642985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":753664,"data_stored":637168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:49:45.163 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-21T01:49:45.163 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.164 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-21T01:49:45.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.164 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-21T01:49:45.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.164 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-21T01:49:45.164 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.165 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-21T01:49:45.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.165 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-21T01:49:45.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.165 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-21T01:49:45.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.165 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-21T01:49:45.165 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-21T01:49:45.166 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-21T01:49:45.167 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-21T01:49:45.168 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-21T01:49:45.169 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.332681+0000', 'last_change': '2024-09-21T01:49:38.332681+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.332681+0000', 'last_undegraded': '2024-09-21T01:49:38.332681+0000', 'last_fullsized': '2024-09-21T01:49:38.332681+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.334373+0000', 'last_change': '2024-09-21T01:49:38.334373+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.334373+0000', 'last_undegraded': '2024-09-21T01:49:38.334373+0000', 'last_fullsized': '2024-09-21T01:49:38.334373+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.332887+0000', 'last_change': '2024-09-21T01:49:38.332887+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.332887+0000', 'last_undegraded': '2024-09-21T01:49:38.332887+0000', 'last_fullsized': '2024-09-21T01:49:38.332887+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:PG 2.18 is not active+clean 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.335957+0000', 'last_change': '2024-09-21T01:49:38.335957+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.335957+0000', 'last_undegraded': '2024-09-21T01:49:38.335957+0000', 'last_fullsized': '2024-09-21T01:49:38.335957+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T01:49:45.170 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.335396+0000', 'last_change': '2024-09-21T01:49:38.335396+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.335396+0000', 'last_undegraded': '2024-09-21T01:49:38.335396+0000', 'last_fullsized': '2024-09-21T01:49:38.335396+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:PG 2.16 is not active+clean 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.337226+0000', 'last_change': '2024-09-21T01:49:38.337226+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.337226+0000', 'last_undegraded': '2024-09-21T01:49:38.337226+0000', 'last_fullsized': '2024-09-21T01:49:38.337226+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-21T01:49:45.171 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.334460+0000', 'last_change': '2024-09-21T01:49:38.334460+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.334460+0000', 'last_undegraded': '2024-09-21T01:49:38.334460+0000', 'last_fullsized': '2024-09-21T01:49:38.334460+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.334068+0000', 'last_change': '2024-09-21T01:49:38.334068+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.334068+0000', 'last_undegraded': '2024-09-21T01:49:38.334068+0000', 'last_fullsized': '2024-09-21T01:49:38.334068+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:PG 2.12 is not active+clean 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.337601+0000', 'last_change': '2024-09-21T01:49:38.337601+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.337601+0000', 'last_undegraded': '2024-09-21T01:49:38.337601+0000', 'last_fullsized': '2024-09-21T01:49:38.337601+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-21T01:49:45.172 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.334806+0000', 'last_change': '2024-09-21T01:49:38.334806+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.334806+0000', 'last_undegraded': '2024-09-21T01:49:38.334806+0000', 'last_fullsized': '2024-09-21T01:49:38.334806+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.334791+0000', 'last_change': '2024-09-21T01:49:38.334791+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.334791+0000', 'last_undegraded': '2024-09-21T01:49:38.334791+0000', 'last_fullsized': '2024-09-21T01:49:38.334791+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-21T01:49:45.173 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:PG 2.3 is not active+clean 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.336739+0000', 'last_change': '2024-09-21T01:49:38.336739+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.336739+0000', 'last_undegraded': '2024-09-21T01:49:38.336739+0000', 'last_fullsized': '2024-09-21T01:49:38.336739+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.332637+0000', 'last_change': '2024-09-21T01:49:38.332637+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.332637+0000', 'last_undegraded': '2024-09-21T01:49:38.332637+0000', 'last_fullsized': '2024-09-21T01:49:38.332637+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-21T01:49:45.174 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:PG 2.2 is not active+clean 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.336796+0000', 'last_change': '2024-09-21T01:49:38.336796+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.336796+0000', 'last_undegraded': '2024-09-21T01:49:38.336796+0000', 'last_fullsized': '2024-09-21T01:49:38.336796+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.332889+0000', 'last_change': '2024-09-21T01:49:38.332889+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.332889+0000', 'last_undegraded': '2024-09-21T01:49:38.332889+0000', 'last_fullsized': '2024-09-21T01:49:38.332889+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-21T01:49:45.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.334420+0000', 'last_change': '2024-09-21T01:49:38.334420+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.334420+0000', 'last_undegraded': '2024-09-21T01:49:38.334420+0000', 'last_fullsized': '2024-09-21T01:49:38.334420+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.333317+0000', 'last_change': '2024-09-21T01:49:38.333317+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.333317+0000', 'last_undegraded': '2024-09-21T01:49:38.333317+0000', 'last_fullsized': '2024-09-21T01:49:38.333317+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.176 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.332663+0000', 'last_change': '2024-09-21T01:49:38.332663+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.332663+0000', 'last_undegraded': '2024-09-21T01:49:38.332663+0000', 'last_fullsized': '2024-09-21T01:49:38.332663+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.332634+0000', 'last_change': '2024-09-21T01:49:38.332634+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.332634+0000', 'last_undegraded': '2024-09-21T01:49:38.332634+0000', 'last_fullsized': '2024-09-21T01:49:38.332634+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.333921+0000', 'last_change': '2024-09-21T01:49:38.333921+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.333921+0000', 'last_undegraded': '2024-09-21T01:49:38.333921+0000', 'last_fullsized': '2024-09-21T01:49:38.333921+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T01:49:45.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-21T01:49:45.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.178 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-21T01:49:45.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.332767+0000', 'last_change': '2024-09-21T01:49:38.332767+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.332767+0000', 'last_undegraded': '2024-09-21T01:49:38.332767+0000', 'last_fullsized': '2024-09-21T01:49:38.332767+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T01:49:45.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-21T01:49:45.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T01:49:39.326767+0000', 'last_change': '2024-09-21T01:49:39.326767+0000', 'last_active': '2024-09-21T01:49:39.326767+0000', 'last_peered': '2024-09-21T01:49:39.326767+0000', 'last_clean': '2024-09-21T01:49:39.326767+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:39.326767+0000', 'last_undegraded': '2024-09-21T01:49:39.326767+0000', 'last_fullsized': '2024-09-21T01:49:39.326767+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:39.326767+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T01:49:45.178 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-21T01:49:45.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-21T01:49:38.333814+0000', 'last_change': '2024-09-21T01:49:38.333814+0000', 'last_active': '2024-09-21T01:49:38.320560+0000', 'last_peered': '2024-09-21T01:49:38.320560+0000', 'last_clean': '2024-09-21T01:49:38.320560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T01:49:38.333814+0000', 'last_undegraded': '2024-09-21T01:49:38.333814+0000', 'last_fullsized': '2024-09-21T01:49:38.333814+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'last_clean_scrub_stamp': '2024-09-21T01:49:38.320560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T01:49:45.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T01:49:45.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.311+0000 7fe90cc27640 1 -- 172.21.15.40:0/609115413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe90815c9b0 msgr2=0x7fe9080ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.311+0000 7fe90cc27640 1 --2- 172.21.15.40:0/609115413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe90815c9b0 0x7fe9080ccfa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009860 tx=0x7fe8fc02a5f0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.312+0000 7fe90cc27640 1 -- 172.21.15.40:0/609115413 shutdown_connections 2024-09-21T01:49:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.312+0000 7fe90cc27640 1 --2- 172.21.15.40:0/609115413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe90815c9b0 0x7fe9080ccfa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.312+0000 7fe90cc27640 1 -- 172.21.15.40:0/609115413 >> 172.21.15.40:0/609115413 conn(0x7fe9080cdc60 msgr2=0x7fe9080ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.312+0000 7fe90cc27640 1 -- 172.21.15.40:0/609115413 shutdown_connections 2024-09-21T01:49:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.312+0000 7fe90cc27640 1 -- 172.21.15.40:0/609115413 wait complete. 2024-09-21T01:49:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.314+0000 7fe90cc27640 1 Processor -- start 2024-09-21T01:49:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.314+0000 7fe90cc27640 1 -- start start 2024-09-21T01:49:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90cc27640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe908073e70 0x7fe908165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90cc27640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe90815c9b0 0x7fe908156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90cc27640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe90815ff30 0x7fe908156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90cc27640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe908166b10 con 0x7fe908073e70 2024-09-21T01:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90cc27640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe908166990 con 0x7fe90815c9b0 2024-09-21T01:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90cc27640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fe908166c90 con 0x7fe90815ff30 2024-09-21T01:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe908073e70 0x7fe908165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe908073e70 0x7fe908165010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50842/0 (socket says 172.21.15.40:50842) 2024-09-21T01:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90659c640 1 -- 172.21.15.40:0/821659652 learned_addr learned my addr 172.21.15.40:0/821659652 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe905d9b640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe90815c9b0 0x7fe908156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe906d9d640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe90815ff30 0x7fe908156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90659c640 1 -- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe90815ff30 msgr2=0x7fe908156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90659c640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe90815ff30 0x7fe908156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90659c640 1 -- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe90815c9b0 msgr2=0x7fe908156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90659c640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe90815c9b0 0x7fe908156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe90659c640 1 -- 172.21.15.40:0/821659652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90813ea70 con 0x7fe908073e70 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe906d9d640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe90815ff30 0x7fe908156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.315+0000 7fe905d9b640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe90815c9b0 0x7fe908156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.316+0000 7fe90659c640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe908073e70 0x7fe908165010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c370 tx=0x7fe8f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.316+0000 7fe8f6ffd640 1 -- 172.21.15.40:0/821659652 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80052d0 con 0x7fe908073e70 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.316+0000 7fe8f6ffd640 1 -- 172.21.15.40:0/821659652 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8f80106a0 con 0x7fe908073e70 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.316+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90813ed50 con 0x7fe908073e70 2024-09-21T01:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.316+0000 7fe8f6ffd640 1 -- 172.21.15.40:0/821659652 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8010af0 con 0x7fe908073e70 2024-09-21T01:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.316+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90813f310 con 0x7fe908073e70 2024-09-21T01:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.317+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9080ccfa0 con 0x7fe908073e70 2024-09-21T01:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.318+0000 7fe8f6ffd640 1 -- 172.21.15.40:0/821659652 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8f8010c90 con 0x7fe908073e70 2024-09-21T01:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.318+0000 7fe8f6ffd640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe8e8078b90 0x7fe8e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.318+0000 7fe8f6ffd640 1 -- 172.21.15.40:0/821659652 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe8f809cc70 con 0x7fe908073e70 2024-09-21T01:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.318+0000 7fe905d9b640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe8e8078b90 0x7fe8e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.319+0000 7fe905d9b640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe8e8078b90 0x7fe8e807b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc034000 tx=0x7fe8fc004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.323+0000 7fe8f6ffd640 1 -- 172.21.15.40:0/821659652 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe8f80650c0 con 0x7fe908073e70 2024-09-21T01:49:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.587+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe9080cc310 con 0x7fe908073e70 2024-09-21T01:49:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.588+0000 7fe8f6ffd640 1 -- 172.21.15.40:0/821659652 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1053 (secure 0 0 0) 0x7fe8f80649c0 con 0x7fe908073e70 2024-09-21T01:49:45.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:45.589 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726883368,"num_in_osds":8,"osd_in_since":1726883358,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224370688,"bytes_avail":772869742592,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"btime":"2024-09-21T01:49:43:356671+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4410}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-21T01:49:14.899667+0000","services":{}},"progress_events":{}} 2024-09-21T01:49:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe8e8078b90 msgr2=0x7fe8e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe8e8078b90 0x7fe8e807b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc034000 tx=0x7fe8fc004730 comp rx=0 tx=0).stop 2024-09-21T01:49:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe908073e70 msgr2=0x7fe908165010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe908073e70 0x7fe908165010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8f800c370 tx=0x7fe8f800c830 comp rx=0 tx=0).stop 2024-09-21T01:49:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 shutdown_connections 2024-09-21T01:49:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe8e8078b90 0x7fe8e807b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe90815ff30 0x7fe908156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe90815c9b0 0x7fe908156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 --2- 172.21.15.40:0/821659652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe908073e70 0x7fe908165010 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 >> 172.21.15.40:0/821659652 conn(0x7fe9080cdc60 msgr2=0x7fe90806fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 shutdown_connections 2024-09-21T01:49:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.590+0000 7fe90cc27640 1 -- 172.21.15.40:0/821659652 wait complete. 2024-09-21T01:49:45.602 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T01:49:45.602 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:49:45.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.717+0000 7ff727e4d640 1 -- 172.21.15.40:0/3114343860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200ccbd0 msgr2=0x7ff7200d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.717+0000 7ff727e4d640 1 --2- 172.21.15.40:0/3114343860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200ccbd0 0x7ff7200d0d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff710005fd0 tx=0x7ff71002a5d0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.717+0000 7ff727e4d640 1 -- 172.21.15.40:0/3114343860 shutdown_connections 2024-09-21T01:49:45.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.717+0000 7ff727e4d640 1 --2- 172.21.15.40:0/3114343860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200ccbd0 0x7ff7200d0d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.717+0000 7ff727e4d640 1 --2- 172.21.15.40:0/3114343860 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7200b51c0 0x7ff72015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.717+0000 7ff727e4d640 1 -- 172.21.15.40:0/3114343860 >> 172.21.15.40:0/3114343860 conn(0x7ff720072ae0 msgr2=0x7ff720072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:45.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.718+0000 7ff727e4d640 1 -- 172.21.15.40:0/3114343860 shutdown_connections 2024-09-21T01:49:45.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.718+0000 7ff727e4d640 1 -- 172.21.15.40:0/3114343860 wait complete. 2024-09-21T01:49:45.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.719+0000 7ff727e4d640 1 Processor -- start 2024-09-21T01:49:45.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.719+0000 7ff727e4d640 1 -- start start 2024-09-21T01:49:45.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff727e4d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7200b51c0 0x7ff7200cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:45.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff727e4d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7200ccbd0 0x7ff7201f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:45.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff727e4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200d12c0 0x7ff7201f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:45.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff727e4d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff720160a60 con 0x7ff7200d12c0 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff727e4d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff7200d1a20 con 0x7ff7200b51c0 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff727e4d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7ff720160be0 con 0x7ff7200ccbd0 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7263ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200d12c0 0x7ff7201f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7263ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200d12c0 0x7ff7201f6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50862/0 (socket says 172.21.15.40:50862) 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7263ea640 1 -- 172.21.15.40:0/3107726833 learned_addr learned my addr 172.21.15.40:0/3107726833 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff725be9640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7200b51c0 0x7ff7200cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7253e8640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7200ccbd0 0x7ff7201f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7263ea640 1 -- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7200ccbd0 msgr2=0x7ff7201f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7263ea640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7200ccbd0 0x7ff7201f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7263ea640 1 -- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7200b51c0 msgr2=0x7ff7200cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7263ea640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7200b51c0 0x7ff7200cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7263ea640 1 -- 172.21.15.40:0/3107726833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7200ad9b0 con 0x7ff7200d12c0 2024-09-21T01:49:45.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7263ea640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200d12c0 0x7ff7201f6ca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff71800c730 tx=0x7ff71800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:45.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7167fc640 1 -- 172.21.15.40:0/3107726833 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff718003b70 con 0x7ff7200d12c0 2024-09-21T01:49:45.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7167fc640 1 -- 172.21.15.40:0/3107726833 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff718003d10 con 0x7ff7200d12c0 2024-09-21T01:49:45.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72014c5a0 con 0x7ff7200d12c0 2024-09-21T01:49:45.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff7167fc640 1 -- 172.21.15.40:0/3107726833 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71800aab0 con 0x7ff7200d12c0 2024-09-21T01:49:45.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.721+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7201f34d0 con 0x7ff7200d12c0 2024-09-21T01:49:45.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.723+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7201f7270 con 0x7ff7200d12c0 2024-09-21T01:49:45.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.723+0000 7ff7167fc640 1 -- 172.21.15.40:0/3107726833 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff71800ac50 con 0x7ff7200d12c0 2024-09-21T01:49:45.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.724+0000 7ff7167fc640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff704078b90 0x7ff70407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:45.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.724+0000 7ff7167fc640 1 -- 172.21.15.40:0/3107726833 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff71809abb0 con 0x7ff7200d12c0 2024-09-21T01:49:45.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.724+0000 7ff725be9640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff704078b90 0x7ff70407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:45.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.725+0000 7ff725be9640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff704078b90 0x7ff70407b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009ac0 tx=0x7ff71c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:45.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.729+0000 7ff7167fc640 1 -- 172.21.15.40:0/3107726833 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff718062ff0 con 0x7ff7200d12c0 2024-09-21T01:49:45.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.913+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 --> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7201f7500 con 0x7ff704078b90 2024-09-21T01:49:45.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.918+0000 7ff7167fc640 1 -- 172.21.15.40:0/3107726833 <== mgr.4100 v2:172.21.15.139:6800/852736644 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7ff7201f7500 con 0x7ff704078b90 2024-09-21T01:49:45.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:45.923 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-21T01:49:45.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff704078b90 msgr2=0x7ff70407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff704078b90 0x7ff70407b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009ac0 tx=0x7ff71c005f90 comp rx=0 tx=0).stop 2024-09-21T01:49:45.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200d12c0 msgr2=0x7ff7201f6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:45.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200d12c0 0x7ff7201f6ca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff71800c730 tx=0x7ff71800cbf0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 shutdown_connections 2024-09-21T01:49:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff704078b90 0x7ff70407b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7200d12c0 0x7ff7201f6ca0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff7200ccbd0 0x7ff7201f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 --2- 172.21.15.40:0/3107726833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7200b51c0 0x7ff7200cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 >> 172.21.15.40:0/3107726833 conn(0x7ff720072ae0 msgr2=0x7ff7200b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 shutdown_connections 2024-09-21T01:49:45.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:45.922+0000 7ff727e4d640 1 -- 172.21.15.40:0/3107726833 wait complete. 2024-09-21T01:49:45.933 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-21T01:49:45.310093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2924544,"data_stored":1761292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001691"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737960+0000","last_change":"2024-09-21T01:49:40.356030+0000","last_active":"2024-09-21T01:49:41.737960+0000","last_peered":"2024-09-21T01:49:41.737960+0000","last_clean":"2024-09-21T01:49:41.737960+0000","last_became_active":"2024-09-21T01:49:40.355677+0000","last_became_peered":"2024-09-21T01:49:40.355677+0000","last_unstale":"2024-09-21T01:49:41.737960+0000","last_undegraded":"2024-09-21T01:49:41.737960+0000","last_fullsized":"2024-09-21T01:49:41.737960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:57.340502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736421+0000","last_change":"2024-09-21T01:49:40.366361+0000","last_active":"2024-09-21T01:49:41.736421+0000","last_peered":"2024-09-21T01:49:41.736421+0000","last_clean":"2024-09-21T01:49:41.736421+0000","last_became_active":"2024-09-21T01:49:40.366008+0000","last_became_peered":"2024-09-21T01:49:40.366008+0000","last_unstale":"2024-09-21T01:49:41.736421+0000","last_undegraded":"2024-09-21T01:49:41.736421+0000","last_fullsized":"2024-09-21T01:49:41.736421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:30.129619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350613+0000","last_change":"2024-09-21T01:49:40.349571+0000","last_active":"2024-09-21T01:49:41.350613+0000","last_peered":"2024-09-21T01:49:41.350613+0000","last_clean":"2024-09-21T01:49:41.350613+0000","last_became_active":"2024-09-21T01:49:40.349241+0000","last_became_peered":"2024-09-21T01:49:40.349241+0000","last_unstale":"2024-09-21T01:49:41.350613+0000","last_undegraded":"2024-09-21T01:49:41.350613+0000","last_fullsized":"2024-09-21T01:49:41.350613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.999168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736794+0000","last_change":"2024-09-21T01:49:40.372236+0000","last_active":"2024-09-21T01:49:41.736794+0000","last_peered":"2024-09-21T01:49:41.736794+0000","last_clean":"2024-09-21T01:49:41.736794+0000","last_became_active":"2024-09-21T01:49:40.371944+0000","last_became_peered":"2024-09-21T01:49:40.371944+0000","last_unstale":"2024-09-21T01:49:41.736794+0000","last_undegraded":"2024-09-21T01:49:41.736794+0000","last_fullsized":"2024-09-21T01:49:41.736794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:26.563781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737255+0000","last_change":"2024-09-21T01:49:40.358244+0000","last_active":"2024-09-21T01:49:41.737255+0000","last_peered":"2024-09-21T01:49:41.737255+0000","last_clean":"2024-09-21T01:49:41.737255+0000","last_became_active":"2024-09-21T01:49:40.357953+0000","last_became_peered":"2024-09-21T01:49:40.357953+0000","last_unstale":"2024-09-21T01:49:41.737255+0000","last_undegraded":"2024-09-21T01:49:41.737255+0000","last_fullsized":"2024-09-21T01:49:41.737255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:52.645109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736458+0000","last_change":"2024-09-21T01:49:40.370563+0000","last_active":"2024-09-21T01:49:41.736458+0000","last_peered":"2024-09-21T01:49:41.736458+0000","last_clean":"2024-09-21T01:49:41.736458+0000","last_became_active":"2024-09-21T01:49:40.369831+0000","last_became_peered":"2024-09-21T01:49:40.369831+0000","last_unstale":"2024-09-21T01:49:41.736458+0000","last_undegraded":"2024-09-21T01:49:41.736458+0000","last_fullsized":"2024-09-21T01:49:41.736458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736598+0000","last_change":"2024-09-21T01:49:40.364668+0000","last_active":"2024-09-21T01:49:41.736598+0000","last_peered":"2024-09-21T01:49:41.736598+0000","last_clean":"2024-09-21T01:49:41.736598+0000","last_became_active":"2024-09-21T01:49:40.363159+0000","last_became_peered":"2024-09-21T01:49:40.363159+0000","last_unstale":"2024-09-21T01:49:41.736598+0000","last_undegraded":"2024-09-21T01:49:41.736598+0000","last_fullsized":"2024-09-21T01:49:41.736598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:36.062812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351404+0000","last_change":"2024-09-21T01:49:40.363639+0000","last_active":"2024-09-21T01:49:41.351404+0000","last_peered":"2024-09-21T01:49:41.351404+0000","last_clean":"2024-09-21T01:49:41.351404+0000","last_became_active":"2024-09-21T01:49:40.363291+0000","last_became_peered":"2024-09-21T01:49:40.363291+0000","last_unstale":"2024-09-21T01:49:41.351404+0000","last_undegraded":"2024-09-21T01:49:41.351404+0000","last_fullsized":"2024-09-21T01:49:41.351404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:03.841294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737999+0000","last_change":"2024-09-21T01:49:40.366167+0000","last_active":"2024-09-21T01:49:41.737999+0000","last_peered":"2024-09-21T01:49:41.737999+0000","last_clean":"2024-09-21T01:49:41.737999+0000","last_became_active":"2024-09-21T01:49:40.364598+0000","last_became_peered":"2024-09-21T01:49:40.364598+0000","last_unstale":"2024-09-21T01:49:41.737999+0000","last_undegraded":"2024-09-21T01:49:41.737999+0000","last_fullsized":"2024-09-21T01:49:41.737999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:36.012884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535590+0000","last_change":"2024-09-21T01:49:40.368687+0000","last_active":"2024-09-21T01:49:41.535590+0000","last_peered":"2024-09-21T01:49:41.535590+0000","last_clean":"2024-09-21T01:49:41.535590+0000","last_became_active":"2024-09-21T01:49:40.366584+0000","last_became_peered":"2024-09-21T01:49:40.366584+0000","last_unstale":"2024-09-21T01:49:41.535590+0000","last_undegraded":"2024-09-21T01:49:41.535590+0000","last_fullsized":"2024-09-21T01:49:41.535590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535321+0000","last_change":"2024-09-21T01:49:40.358569+0000","last_active":"2024-09-21T01:49:41.535321+0000","last_peered":"2024-09-21T01:49:41.535321+0000","last_clean":"2024-09-21T01:49:41.535321+0000","last_became_active":"2024-09-21T01:49:40.358189+0000","last_became_peered":"2024-09-21T01:49:40.358189+0000","last_unstale":"2024-09-21T01:49:41.535321+0000","last_undegraded":"2024-09-21T01:49:41.535321+0000","last_fullsized":"2024-09-21T01:49:41.535321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.668625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353509+0000","last_change":"2024-09-21T01:49:40.360227+0000","last_active":"2024-09-21T01:49:41.353509+0000","last_peered":"2024-09-21T01:49:41.353509+0000","last_clean":"2024-09-21T01:49:41.353509+0000","last_became_active":"2024-09-21T01:49:40.359457+0000","last_became_peered":"2024-09-21T01:49:40.359457+0000","last_unstale":"2024-09-21T01:49:41.353509+0000","last_undegraded":"2024-09-21T01:49:41.353509+0000","last_fullsized":"2024-09-21T01:49:41.353509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:44.985230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352280+0000","last_change":"2024-09-21T01:49:40.356310+0000","last_active":"2024-09-21T01:49:41.352280+0000","last_peered":"2024-09-21T01:49:41.352280+0000","last_clean":"2024-09-21T01:49:41.352280+0000","last_became_active":"2024-09-21T01:49:40.356004+0000","last_became_peered":"2024-09-21T01:49:40.356004+0000","last_unstale":"2024-09-21T01:49:41.352280+0000","last_undegraded":"2024-09-21T01:49:41.352280+0000","last_fullsized":"2024-09-21T01:49:41.352280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:14.949645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350350+0000","last_change":"2024-09-21T01:49:40.354886+0000","last_active":"2024-09-21T01:49:41.350350+0000","last_peered":"2024-09-21T01:49:41.350350+0000","last_clean":"2024-09-21T01:49:41.350350+0000","last_became_active":"2024-09-21T01:49:40.354489+0000","last_became_peered":"2024-09-21T01:49:40.354489+0000","last_unstale":"2024-09-21T01:49:41.350350+0000","last_undegraded":"2024-09-21T01:49:41.350350+0000","last_fullsized":"2024-09-21T01:49:41.350350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:43.940906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736359+0000","last_change":"2024-09-21T01:49:40.364466+0000","last_active":"2024-09-21T01:49:41.736359+0000","last_peered":"2024-09-21T01:49:41.736359+0000","last_clean":"2024-09-21T01:49:41.736359+0000","last_became_active":"2024-09-21T01:49:40.364098+0000","last_became_peered":"2024-09-21T01:49:40.364098+0000","last_unstale":"2024-09-21T01:49:41.736359+0000","last_undegraded":"2024-09-21T01:49:41.736359+0000","last_fullsized":"2024-09-21T01:49:41.736359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:24.593410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736538+0000","last_change":"2024-09-21T01:49:40.370361+0000","last_active":"2024-09-21T01:49:41.736538+0000","last_peered":"2024-09-21T01:49:41.736538+0000","last_clean":"2024-09-21T01:49:41.736538+0000","last_became_active":"2024-09-21T01:49:40.370046+0000","last_became_peered":"2024-09-21T01:49:40.370046+0000","last_unstale":"2024-09-21T01:49:41.736538+0000","last_undegraded":"2024-09-21T01:49:41.736538+0000","last_fullsized":"2024-09-21T01:49:41.736538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:35.506009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737746+0000","last_change":"2024-09-21T01:49:40.364197+0000","last_active":"2024-09-21T01:49:41.737746+0000","last_peered":"2024-09-21T01:49:41.737746+0000","last_clean":"2024-09-21T01:49:41.737746+0000","last_became_active":"2024-09-21T01:49:40.363906+0000","last_became_peered":"2024-09-21T01:49:40.363906+0000","last_unstale":"2024-09-21T01:49:41.737746+0000","last_undegraded":"2024-09-21T01:49:41.737746+0000","last_fullsized":"2024-09-21T01:49:41.737746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:40.514781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736268+0000","last_change":"2024-09-21T01:49:40.369575+0000","last_active":"2024-09-21T01:49:41.736268+0000","last_peered":"2024-09-21T01:49:41.736268+0000","last_clean":"2024-09-21T01:49:41.736268+0000","last_became_active":"2024-09-21T01:49:40.369160+0000","last_became_peered":"2024-09-21T01:49:40.369160+0000","last_unstale":"2024-09-21T01:49:41.736268+0000","last_undegraded":"2024-09-21T01:49:41.736268+0000","last_fullsized":"2024-09-21T01:49:41.736268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:32.326084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737961+0000","last_change":"2024-09-21T01:49:40.357275+0000","last_active":"2024-09-21T01:49:41.737961+0000","last_peered":"2024-09-21T01:49:41.737961+0000","last_clean":"2024-09-21T01:49:41.737961+0000","last_became_active":"2024-09-21T01:49:40.356956+0000","last_became_peered":"2024-09-21T01:49:40.356956+0000","last_unstale":"2024-09-21T01:49:41.737961+0000","last_undegraded":"2024-09-21T01:49:41.737961+0000","last_fullsized":"2024-09-21T01:49:41.737961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:09.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535522+0000","last_change":"2024-09-21T01:49:40.366142+0000","last_active":"2024-09-21T01:49:41.535522+0000","last_peered":"2024-09-21T01:49:41.535522+0000","last_clean":"2024-09-21T01:49:41.535522+0000","last_became_active":"2024-09-21T01:49:40.365863+0000","last_became_peered":"2024-09-21T01:49:40.365863+0000","last_unstale":"2024-09-21T01:49:41.535522+0000","last_undegraded":"2024-09-21T01:49:41.535522+0000","last_fullsized":"2024-09-21T01:49:41.535522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:24.814662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350661+0000","last_change":"2024-09-21T01:49:40.350221+0000","last_active":"2024-09-21T01:49:41.350661+0000","last_peered":"2024-09-21T01:49:41.350661+0000","last_clean":"2024-09-21T01:49:41.350661+0000","last_became_active":"2024-09-21T01:49:40.349898+0000","last_became_peered":"2024-09-21T01:49:40.349898+0000","last_unstale":"2024-09-21T01:49:41.350661+0000","last_undegraded":"2024-09-21T01:49:41.350661+0000","last_fullsized":"2024-09-21T01:49:41.350661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:12.766064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737119+0000","last_change":"2024-09-21T01:49:40.370844+0000","last_active":"2024-09-21T01:49:41.737119+0000","last_peered":"2024-09-21T01:49:41.737119+0000","last_clean":"2024-09-21T01:49:41.737119+0000","last_became_active":"2024-09-21T01:49:40.369354+0000","last_became_peered":"2024-09-21T01:49:40.369354+0000","last_unstale":"2024-09-21T01:49:41.737119+0000","last_undegraded":"2024-09-21T01:49:41.737119+0000","last_fullsized":"2024-09-21T01:49:41.737119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.916601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351626+0000","last_change":"2024-09-21T01:49:40.352293+0000","last_active":"2024-09-21T01:49:41.351626+0000","last_peered":"2024-09-21T01:49:41.351626+0000","last_clean":"2024-09-21T01:49:41.351626+0000","last_became_active":"2024-09-21T01:49:40.351973+0000","last_became_peered":"2024-09-21T01:49:40.351973+0000","last_unstale":"2024-09-21T01:49:41.351626+0000","last_undegraded":"2024-09-21T01:49:41.351626+0000","last_fullsized":"2024-09-21T01:49:41.351626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:12.766064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736452+0000","last_change":"2024-09-21T01:49:40.371534+0000","last_active":"2024-09-21T01:49:41.736452+0000","last_peered":"2024-09-21T01:49:41.736452+0000","last_clean":"2024-09-21T01:49:41.736452+0000","last_became_active":"2024-09-21T01:49:40.371235+0000","last_became_peered":"2024-09-21T01:49:40.371235+0000","last_unstale":"2024-09-21T01:49:41.736452+0000","last_undegraded":"2024-09-21T01:49:41.736452+0000","last_fullsized":"2024-09-21T01:49:41.736452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351780+0000","last_change":"2024-09-21T01:49:40.361289+0000","last_active":"2024-09-21T01:49:41.351780+0000","last_peered":"2024-09-21T01:49:41.351780+0000","last_clean":"2024-09-21T01:49:41.351780+0000","last_became_active":"2024-09-21T01:49:40.360952+0000","last_became_peered":"2024-09-21T01:49:40.360952+0000","last_unstale":"2024-09-21T01:49:41.351780+0000","last_undegraded":"2024-09-21T01:49:41.351780+0000","last_fullsized":"2024-09-21T01:49:41.351780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:58.888642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535608+0000","last_change":"2024-09-21T01:49:40.356406+0000","last_active":"2024-09-21T01:49:41.535608+0000","last_peered":"2024-09-21T01:49:41.535608+0000","last_clean":"2024-09-21T01:49:41.535608+0000","last_became_active":"2024-09-21T01:49:40.355941+0000","last_became_peered":"2024-09-21T01:49:40.355941+0000","last_unstale":"2024-09-21T01:49:41.535608+0000","last_undegraded":"2024-09-21T01:49:41.535608+0000","last_fullsized":"2024-09-21T01:49:41.535608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736560+0000","last_change":"2024-09-21T01:49:40.354384+0000","last_active":"2024-09-21T01:49:41.736560+0000","last_peered":"2024-09-21T01:49:41.736560+0000","last_clean":"2024-09-21T01:49:41.736560+0000","last_became_active":"2024-09-21T01:49:40.354065+0000","last_became_peered":"2024-09-21T01:49:40.354065+0000","last_unstale":"2024-09-21T01:49:41.736560+0000","last_undegraded":"2024-09-21T01:49:41.736560+0000","last_fullsized":"2024-09-21T01:49:41.736560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:43.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352248+0000","last_change":"2024-09-21T01:49:40.347679+0000","last_active":"2024-09-21T01:49:41.352248+0000","last_peered":"2024-09-21T01:49:41.352248+0000","last_clean":"2024-09-21T01:49:41.352248+0000","last_became_active":"2024-09-21T01:49:40.347302+0000","last_became_peered":"2024-09-21T01:49:40.347302+0000","last_unstale":"2024-09-21T01:49:41.352248+0000","last_undegraded":"2024-09-21T01:49:41.352248+0000","last_fullsized":"2024-09-21T01:49:41.352248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:00.866709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351058+0000","last_change":"2024-09-21T01:49:40.351144+0000","last_active":"2024-09-21T01:49:41.351058+0000","last_peered":"2024-09-21T01:49:41.351058+0000","last_clean":"2024-09-21T01:49:41.351058+0000","last_became_active":"2024-09-21T01:49:40.350778+0000","last_became_peered":"2024-09-21T01:49:40.350778+0000","last_unstale":"2024-09-21T01:49:41.351058+0000","last_undegraded":"2024-09-21T01:49:41.351058+0000","last_fullsized":"2024-09-21T01:49:41.351058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737667+0000","last_change":"2024-09-21T01:49:40.372249+0000","last_active":"2024-09-21T01:49:41.737667+0000","last_peered":"2024-09-21T01:49:41.737667+0000","last_clean":"2024-09-21T01:49:41.737667+0000","last_became_active":"2024-09-21T01:49:40.371920+0000","last_became_peered":"2024-09-21T01:49:40.371920+0000","last_unstale":"2024-09-21T01:49:41.737667+0000","last_undegraded":"2024-09-21T01:49:41.737667+0000","last_fullsized":"2024-09-21T01:49:41.737667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:57.340502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735902+0000","last_change":"2024-09-21T01:49:40.365077+0000","last_active":"2024-09-21T01:49:41.735902+0000","last_peered":"2024-09-21T01:49:41.735902+0000","last_clean":"2024-09-21T01:49:41.735902+0000","last_became_active":"2024-09-21T01:49:40.364475+0000","last_became_peered":"2024-09-21T01:49:40.364475+0000","last_unstale":"2024-09-21T01:49:41.735902+0000","last_undegraded":"2024-09-21T01:49:41.735902+0000","last_fullsized":"2024-09-21T01:49:41.735902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:16.394801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535444+0000","last_change":"2024-09-21T01:49:40.364957+0000","last_active":"2024-09-21T01:49:41.535444+0000","last_peered":"2024-09-21T01:49:41.535444+0000","last_clean":"2024-09-21T01:49:41.535444+0000","last_became_active":"2024-09-21T01:49:40.363773+0000","last_became_peered":"2024-09-21T01:49:40.363773+0000","last_unstale":"2024-09-21T01:49:41.535444+0000","last_undegraded":"2024-09-21T01:49:41.535444+0000","last_fullsized":"2024-09-21T01:49:41.535444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:36.817174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353667+0000","last_change":"2024-09-21T01:49:40.362548+0000","last_active":"2024-09-21T01:49:41.353667+0000","last_peered":"2024-09-21T01:49:41.353667+0000","last_clean":"2024-09-21T01:49:41.353667+0000","last_became_active":"2024-09-21T01:49:40.362006+0000","last_became_peered":"2024-09-21T01:49:40.362006+0000","last_unstale":"2024-09-21T01:49:41.353667+0000","last_undegraded":"2024-09-21T01:49:41.353667+0000","last_fullsized":"2024-09-21T01:49:41.353667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:09:20.837466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352351+0000","last_change":"2024-09-21T01:49:39.354635+0000","last_active":"2024-09-21T01:49:41.352351+0000","last_peered":"2024-09-21T01:49:41.352351+0000","last_clean":"2024-09-21T01:49:41.352351+0000","last_became_active":"2024-09-21T01:49:39.354261+0000","last_became_peered":"2024-09-21T01:49:39.354261+0000","last_unstale":"2024-09-21T01:49:41.352351+0000","last_undegraded":"2024-09-21T01:49:41.352351+0000","last_fullsized":"2024-09-21T01:49:41.352351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:43.205610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350925+0000","last_change":"2024-09-21T01:49:40.356386+0000","last_active":"2024-09-21T01:49:41.350925+0000","last_peered":"2024-09-21T01:49:41.350925+0000","last_clean":"2024-09-21T01:49:41.350925+0000","last_became_active":"2024-09-21T01:49:40.356070+0000","last_became_peered":"2024-09-21T01:49:40.356070+0000","last_unstale":"2024-09-21T01:49:41.350925+0000","last_undegraded":"2024-09-21T01:49:41.350925+0000","last_fullsized":"2024-09-21T01:49:41.350925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535066+0000","last_change":"2024-09-21T01:49:39.345519+0000","last_active":"2024-09-21T01:49:41.535066+0000","last_peered":"2024-09-21T01:49:41.535066+0000","last_clean":"2024-09-21T01:49:41.535066+0000","last_became_active":"2024-09-21T01:49:39.345204+0000","last_became_peered":"2024-09-21T01:49:39.345204+0000","last_unstale":"2024-09-21T01:49:41.535066+0000","last_undegraded":"2024-09-21T01:49:41.535066+0000","last_fullsized":"2024-09-21T01:49:41.535066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:43.979023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351716+0000","last_change":"2024-09-21T01:49:39.348849+0000","last_active":"2024-09-21T01:49:41.351716+0000","last_peered":"2024-09-21T01:49:41.351716+0000","last_clean":"2024-09-21T01:49:41.351716+0000","last_became_active":"2024-09-21T01:49:39.348541+0000","last_became_peered":"2024-09-21T01:49:39.348541+0000","last_unstale":"2024-09-21T01:49:41.351716+0000","last_undegraded":"2024-09-21T01:49:41.351716+0000","last_fullsized":"2024-09-21T01:49:41.351716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:45.215963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351473+0000","last_change":"2024-09-21T01:49:40.357207+0000","last_active":"2024-09-21T01:49:41.351473+0000","last_peered":"2024-09-21T01:49:41.351473+0000","last_clean":"2024-09-21T01:49:41.351473+0000","last_became_active":"2024-09-21T01:49:40.356888+0000","last_became_peered":"2024-09-21T01:49:40.356888+0000","last_unstale":"2024-09-21T01:49:41.351473+0000","last_undegraded":"2024-09-21T01:49:41.351473+0000","last_fullsized":"2024-09-21T01:49:41.351473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:47.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736549+0000","last_change":"2024-09-21T01:49:39.358208+0000","last_active":"2024-09-21T01:49:41.736549+0000","last_peered":"2024-09-21T01:49:41.736549+0000","last_clean":"2024-09-21T01:49:41.736549+0000","last_became_active":"2024-09-21T01:49:39.357751+0000","last_became_peered":"2024-09-21T01:49:39.357751+0000","last_unstale":"2024-09-21T01:49:41.736549+0000","last_undegraded":"2024-09-21T01:49:41.736549+0000","last_fullsized":"2024-09-21T01:49:41.736549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:17.291066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736125+0000","last_change":"2024-09-21T01:49:40.352449+0000","last_active":"2024-09-21T01:49:41.736125+0000","last_peered":"2024-09-21T01:49:41.736125+0000","last_clean":"2024-09-21T01:49:41.736125+0000","last_became_active":"2024-09-21T01:49:40.352149+0000","last_became_peered":"2024-09-21T01:49:40.352149+0000","last_unstale":"2024-09-21T01:49:41.736125+0000","last_undegraded":"2024-09-21T01:49:41.736125+0000","last_fullsized":"2024-09-21T01:49:41.736125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:11.903566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535350+0000","last_change":"2024-09-21T01:49:39.356457+0000","last_active":"2024-09-21T01:49:41.535350+0000","last_peered":"2024-09-21T01:49:41.535350+0000","last_clean":"2024-09-21T01:49:41.535350+0000","last_became_active":"2024-09-21T01:49:39.356087+0000","last_became_peered":"2024-09-21T01:49:39.356087+0000","last_unstale":"2024-09-21T01:49:41.535350+0000","last_undegraded":"2024-09-21T01:49:41.535350+0000","last_fullsized":"2024-09-21T01:49:41.535350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:02.371670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737704+0000","last_change":"2024-09-21T01:49:40.356593+0000","last_active":"2024-09-21T01:49:41.737704+0000","last_peered":"2024-09-21T01:49:41.737704+0000","last_clean":"2024-09-21T01:49:41.737704+0000","last_became_active":"2024-09-21T01:49:40.356244+0000","last_became_peered":"2024-09-21T01:49:40.356244+0000","last_unstale":"2024-09-21T01:49:41.737704+0000","last_undegraded":"2024-09-21T01:49:41.737704+0000","last_fullsized":"2024-09-21T01:49:41.737704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:34.045247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737251+0000","last_change":"2024-09-21T01:49:39.356069+0000","last_active":"2024-09-21T01:49:41.737251+0000","last_peered":"2024-09-21T01:49:41.737251+0000","last_clean":"2024-09-21T01:49:41.737251+0000","last_became_active":"2024-09-21T01:49:39.355711+0000","last_became_peered":"2024-09-21T01:49:39.355711+0000","last_unstale":"2024-09-21T01:49:41.737251+0000","last_undegraded":"2024-09-21T01:49:41.737251+0000","last_fullsized":"2024-09-21T01:49:41.737251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:26.423985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350888+0000","last_change":"2024-09-21T01:49:40.365005+0000","last_active":"2024-09-21T01:49:41.350888+0000","last_peered":"2024-09-21T01:49:41.350888+0000","last_clean":"2024-09-21T01:49:41.350888+0000","last_became_active":"2024-09-21T01:49:40.364593+0000","last_became_peered":"2024-09-21T01:49:40.364593+0000","last_unstale":"2024-09-21T01:49:41.350888+0000","last_undegraded":"2024-09-21T01:49:41.350888+0000","last_fullsized":"2024-09-21T01:49:41.350888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:24.814662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736394+0000","last_change":"2024-09-21T01:49:39.354177+0000","last_active":"2024-09-21T01:49:41.736394+0000","last_peered":"2024-09-21T01:49:41.736394+0000","last_clean":"2024-09-21T01:49:41.736394+0000","last_became_active":"2024-09-21T01:49:39.353830+0000","last_became_peered":"2024-09-21T01:49:39.353830+0000","last_unstale":"2024-09-21T01:49:41.736394+0000","last_undegraded":"2024-09-21T01:49:41.736394+0000","last_fullsized":"2024-09-21T01:49:41.736394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:15.388595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353615+0000","last_change":"2024-09-21T01:49:40.351596+0000","last_active":"2024-09-21T01:49:41.353615+0000","last_peered":"2024-09-21T01:49:41.353615+0000","last_clean":"2024-09-21T01:49:41.353615+0000","last_became_active":"2024-09-21T01:49:40.350101+0000","last_became_peered":"2024-09-21T01:49:40.350101+0000","last_unstale":"2024-09-21T01:49:41.353615+0000","last_undegraded":"2024-09-21T01:49:41.353615+0000","last_fullsized":"2024-09-21T01:49:41.353615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:48.287340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535256+0000","last_change":"2024-09-21T01:49:39.347072+0000","last_active":"2024-09-21T01:49:41.535256+0000","last_peered":"2024-09-21T01:49:41.535256+0000","last_clean":"2024-09-21T01:49:41.535256+0000","last_became_active":"2024-09-21T01:49:39.346726+0000","last_became_peered":"2024-09-21T01:49:39.346726+0000","last_unstale":"2024-09-21T01:49:41.535256+0000","last_undegraded":"2024-09-21T01:49:41.535256+0000","last_fullsized":"2024-09-21T01:49:41.535256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:47.281134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737098+0000","last_change":"2024-09-21T01:49:40.361933+0000","last_active":"2024-09-21T01:49:41.737098+0000","last_peered":"2024-09-21T01:49:41.737098+0000","last_clean":"2024-09-21T01:49:41.737098+0000","last_became_active":"2024-09-21T01:49:40.361599+0000","last_became_peered":"2024-09-21T01:49:40.361599+0000","last_unstale":"2024-09-21T01:49:41.737098+0000","last_undegraded":"2024-09-21T01:49:41.737098+0000","last_fullsized":"2024-09-21T01:49:41.737098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:14.949645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351000+0000","last_change":"2024-09-21T01:49:39.352696+0000","last_active":"2024-09-21T01:49:41.351000+0000","last_peered":"2024-09-21T01:49:41.351000+0000","last_clean":"2024-09-21T01:49:41.351000+0000","last_became_active":"2024-09-21T01:49:39.352336+0000","last_became_peered":"2024-09-21T01:49:39.352336+0000","last_unstale":"2024-09-21T01:49:41.351000+0000","last_undegraded":"2024-09-21T01:49:41.351000+0000","last_fullsized":"2024-09-21T01:49:41.351000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:43.205610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350554+0000","last_change":"2024-09-21T01:49:40.349301+0000","last_active":"2024-09-21T01:49:41.350554+0000","last_peered":"2024-09-21T01:49:41.350554+0000","last_clean":"2024-09-21T01:49:41.350554+0000","last_became_active":"2024-09-21T01:49:40.348932+0000","last_became_peered":"2024-09-21T01:49:40.348932+0000","last_unstale":"2024-09-21T01:49:41.350554+0000","last_undegraded":"2024-09-21T01:49:41.350554+0000","last_fullsized":"2024-09-21T01:49:41.350554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:26.393817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737256+0000","last_change":"2024-09-21T01:49:39.354615+0000","last_active":"2024-09-21T01:49:41.737256+0000","last_peered":"2024-09-21T01:49:41.737256+0000","last_clean":"2024-09-21T01:49:41.737256+0000","last_became_active":"2024-09-21T01:49:39.354155+0000","last_became_peered":"2024-09-21T01:49:39.354155+0000","last_unstale":"2024-09-21T01:49:41.737256+0000","last_undegraded":"2024-09-21T01:49:41.737256+0000","last_fullsized":"2024-09-21T01:49:41.737256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:17.741128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737707+0000","last_change":"2024-09-21T01:49:40.358953+0000","last_active":"2024-09-21T01:49:41.737707+0000","last_peered":"2024-09-21T01:49:41.737707+0000","last_clean":"2024-09-21T01:49:41.737707+0000","last_became_active":"2024-09-21T01:49:40.358659+0000","last_became_peered":"2024-09-21T01:49:40.358659+0000","last_unstale":"2024-09-21T01:49:41.737707+0000","last_undegraded":"2024-09-21T01:49:41.737707+0000","last_fullsized":"2024-09-21T01:49:41.737707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.223285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535008+0000","last_change":"2024-09-21T01:49:39.344739+0000","last_active":"2024-09-21T01:49:41.535008+0000","last_peered":"2024-09-21T01:49:41.535008+0000","last_clean":"2024-09-21T01:49:41.535008+0000","last_became_active":"2024-09-21T01:49:39.344397+0000","last_became_peered":"2024-09-21T01:49:39.344397+0000","last_unstale":"2024-09-21T01:49:41.535008+0000","last_undegraded":"2024-09-21T01:49:41.535008+0000","last_fullsized":"2024-09-21T01:49:41.535008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:27.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535220+0000","last_change":"2024-09-21T01:49:40.364133+0000","last_active":"2024-09-21T01:49:41.535220+0000","last_peered":"2024-09-21T01:49:41.535220+0000","last_clean":"2024-09-21T01:49:41.535220+0000","last_became_active":"2024-09-21T01:49:40.363324+0000","last_became_peered":"2024-09-21T01:49:40.363324+0000","last_unstale":"2024-09-21T01:49:41.535220+0000","last_undegraded":"2024-09-21T01:49:41.535220+0000","last_fullsized":"2024-09-21T01:49:41.535220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:47.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735791+0000","last_change":"2024-09-21T01:49:39.352951+0000","last_active":"2024-09-21T01:49:41.735791+0000","last_peered":"2024-09-21T01:49:41.735791+0000","last_clean":"2024-09-21T01:49:41.735791+0000","last_became_active":"2024-09-21T01:49:39.352592+0000","last_became_peered":"2024-09-21T01:49:39.352592+0000","last_unstale":"2024-09-21T01:49:41.735791+0000","last_undegraded":"2024-09-21T01:49:41.735791+0000","last_fullsized":"2024-09-21T01:49:41.735791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:21.017265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737020+0000","last_change":"2024-09-21T01:49:40.356971+0000","last_active":"2024-09-21T01:49:41.737020+0000","last_peered":"2024-09-21T01:49:41.737020+0000","last_clean":"2024-09-21T01:49:41.737020+0000","last_became_active":"2024-09-21T01:49:40.356575+0000","last_became_peered":"2024-09-21T01:49:40.356575+0000","last_unstale":"2024-09-21T01:49:41.737020+0000","last_undegraded":"2024-09-21T01:49:41.737020+0000","last_fullsized":"2024-09-21T01:49:41.737020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:00.866709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353420+0000","last_change":"2024-09-21T01:49:39.350322+0000","last_active":"2024-09-21T01:49:41.353420+0000","last_peered":"2024-09-21T01:49:41.353420+0000","last_clean":"2024-09-21T01:49:41.353420+0000","last_became_active":"2024-09-21T01:49:39.349770+0000","last_became_peered":"2024-09-21T01:49:39.349770+0000","last_unstale":"2024-09-21T01:49:41.353420+0000","last_undegraded":"2024-09-21T01:49:41.353420+0000","last_fullsized":"2024-09-21T01:49:41.353420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:26.105437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737557+0000","last_change":"2024-09-21T01:49:40.364278+0000","last_active":"2024-09-21T01:49:41.737557+0000","last_peered":"2024-09-21T01:49:41.737557+0000","last_clean":"2024-09-21T01:49:41.737557+0000","last_became_active":"2024-09-21T01:49:40.363949+0000","last_became_peered":"2024-09-21T01:49:40.363949+0000","last_unstale":"2024-09-21T01:49:41.737557+0000","last_undegraded":"2024-09-21T01:49:41.737557+0000","last_fullsized":"2024-09-21T01:49:41.737557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:45.719101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736424+0000","last_change":"2024-09-21T01:49:39.346299+0000","last_active":"2024-09-21T01:49:41.736424+0000","last_peered":"2024-09-21T01:49:41.736424+0000","last_clean":"2024-09-21T01:49:41.736424+0000","last_became_active":"2024-09-21T01:49:39.345944+0000","last_became_peered":"2024-09-21T01:49:39.345944+0000","last_unstale":"2024-09-21T01:49:41.736424+0000","last_undegraded":"2024-09-21T01:49:41.736424+0000","last_fullsized":"2024-09-21T01:49:41.736424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:19.582036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.738129+0000","last_change":"2024-09-21T01:49:40.364893+0000","last_active":"2024-09-21T01:49:41.738129+0000","last_peered":"2024-09-21T01:49:41.738129+0000","last_clean":"2024-09-21T01:49:41.738129+0000","last_became_active":"2024-09-21T01:49:40.364145+0000","last_became_peered":"2024-09-21T01:49:40.364145+0000","last_unstale":"2024-09-21T01:49:41.738129+0000","last_undegraded":"2024-09-21T01:49:41.738129+0000","last_fullsized":"2024-09-21T01:49:41.738129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:03.444824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736525+0000","last_change":"2024-09-21T01:49:39.341903+0000","last_active":"2024-09-21T01:49:41.736525+0000","last_peered":"2024-09-21T01:49:41.736525+0000","last_clean":"2024-09-21T01:49:41.736525+0000","last_became_active":"2024-09-21T01:49:39.339820+0000","last_became_peered":"2024-09-21T01:49:39.339820+0000","last_unstale":"2024-09-21T01:49:41.736525+0000","last_undegraded":"2024-09-21T01:49:41.736525+0000","last_fullsized":"2024-09-21T01:49:41.736525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:09.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737057+0000","last_change":"2024-09-21T01:49:40.371573+0000","last_active":"2024-09-21T01:49:41.737057+0000","last_peered":"2024-09-21T01:49:41.737057+0000","last_clean":"2024-09-21T01:49:41.737057+0000","last_became_active":"2024-09-21T01:49:40.371260+0000","last_became_peered":"2024-09-21T01:49:40.371260+0000","last_unstale":"2024-09-21T01:49:41.737057+0000","last_undegraded":"2024-09-21T01:49:41.737057+0000","last_fullsized":"2024-09-21T01:49:41.737057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:52.256418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735984+0000","last_change":"2024-09-21T01:49:39.357807+0000","last_active":"2024-09-21T01:49:41.735984+0000","last_peered":"2024-09-21T01:49:41.735984+0000","last_clean":"2024-09-21T01:49:41.735984+0000","last_became_active":"2024-09-21T01:49:39.357452+0000","last_became_peered":"2024-09-21T01:49:39.357452+0000","last_unstale":"2024-09-21T01:49:41.735984+0000","last_undegraded":"2024-09-21T01:49:41.735984+0000","last_fullsized":"2024-09-21T01:49:41.735984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:13.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737329+0000","last_change":"2024-09-21T01:49:40.361593+0000","last_active":"2024-09-21T01:49:41.737329+0000","last_peered":"2024-09-21T01:49:41.737329+0000","last_clean":"2024-09-21T01:49:41.737329+0000","last_became_active":"2024-09-21T01:49:40.360542+0000","last_became_peered":"2024-09-21T01:49:40.360542+0000","last_unstale":"2024-09-21T01:49:41.737329+0000","last_undegraded":"2024-09-21T01:49:41.737329+0000","last_fullsized":"2024-09-21T01:49:41.737329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:42.329087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736838+0000","last_change":"2024-09-21T01:49:29.995848+0000","last_active":"2024-09-21T01:49:41.736838+0000","last_peered":"2024-09-21T01:49:41.736838+0000","last_clean":"2024-09-21T01:49:41.736838+0000","last_became_active":"2024-09-21T01:49:29.994790+0000","last_became_peered":"2024-09-21T01:49:29.994790+0000","last_unstale":"2024-09-21T01:49:41.736838+0000","last_undegraded":"2024-09-21T01:49:41.736838+0000","last_fullsized":"2024-09-21T01:49:41.736838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_clean_scrub_stamp":"2024-09-21T01:49:28.252238+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:30.318506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736286+0000","last_change":"2024-09-21T01:49:39.356186+0000","last_active":"2024-09-21T01:49:41.736286+0000","last_peered":"2024-09-21T01:49:41.736286+0000","last_clean":"2024-09-21T01:49:41.736286+0000","last_became_active":"2024-09-21T01:49:39.354842+0000","last_became_peered":"2024-09-21T01:49:39.354842+0000","last_unstale":"2024-09-21T01:49:41.736286+0000","last_undegraded":"2024-09-21T01:49:41.736286+0000","last_fullsized":"2024-09-21T01:49:41.736286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352187+0000","last_change":"2024-09-21T01:49:40.363797+0000","last_active":"2024-09-21T01:49:41.352187+0000","last_peered":"2024-09-21T01:49:41.352187+0000","last_clean":"2024-09-21T01:49:41.352187+0000","last_became_active":"2024-09-21T01:49:40.363490+0000","last_became_peered":"2024-09-21T01:49:40.363490+0000","last_unstale":"2024-09-21T01:49:41.352187+0000","last_undegraded":"2024-09-21T01:49:41.352187+0000","last_fullsized":"2024-09-21T01:49:41.352187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:36.062812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736708+0000","last_change":"2024-09-21T01:49:39.356359+0000","last_active":"2024-09-21T01:49:41.736708+0000","last_peered":"2024-09-21T01:49:41.736708+0000","last_clean":"2024-09-21T01:49:41.736708+0000","last_became_active":"2024-09-21T01:49:39.356029+0000","last_became_peered":"2024-09-21T01:49:39.356029+0000","last_unstale":"2024-09-21T01:49:41.736708+0000","last_undegraded":"2024-09-21T01:49:41.736708+0000","last_fullsized":"2024-09-21T01:49:41.736708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:47.281134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350257+0000","last_change":"2024-09-21T01:49:40.346325+0000","last_active":"2024-09-21T01:49:41.350257+0000","last_peered":"2024-09-21T01:49:41.350257+0000","last_clean":"2024-09-21T01:49:41.350257+0000","last_became_active":"2024-09-21T01:49:40.345976+0000","last_became_peered":"2024-09-21T01:49:40.345976+0000","last_unstale":"2024-09-21T01:49:41.350257+0000","last_undegraded":"2024-09-21T01:49:41.350257+0000","last_fullsized":"2024-09-21T01:49:41.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:16.293654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736138+0000","last_change":"2024-09-21T01:49:39.346504+0000","last_active":"2024-09-21T01:49:41.736138+0000","last_peered":"2024-09-21T01:49:41.736138+0000","last_clean":"2024-09-21T01:49:41.736138+0000","last_became_active":"2024-09-21T01:49:39.345964+0000","last_became_peered":"2024-09-21T01:49:39.345964+0000","last_unstale":"2024-09-21T01:49:41.736138+0000","last_undegraded":"2024-09-21T01:49:41.736138+0000","last_fullsized":"2024-09-21T01:49:41.736138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736581+0000","last_change":"2024-09-21T01:49:40.355895+0000","last_active":"2024-09-21T01:49:41.736581+0000","last_peered":"2024-09-21T01:49:41.736581+0000","last_clean":"2024-09-21T01:49:41.736581+0000","last_became_active":"2024-09-21T01:49:40.355565+0000","last_became_peered":"2024-09-21T01:49:40.355565+0000","last_unstale":"2024-09-21T01:49:41.736581+0000","last_undegraded":"2024-09-21T01:49:41.736581+0000","last_fullsized":"2024-09-21T01:49:41.736581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:32.806782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737699+0000","last_change":"2024-09-21T01:49:39.354243+0000","last_active":"2024-09-21T01:49:41.737699+0000","last_peered":"2024-09-21T01:49:41.737699+0000","last_clean":"2024-09-21T01:49:41.737699+0000","last_became_active":"2024-09-21T01:49:39.353072+0000","last_became_peered":"2024-09-21T01:49:39.353072+0000","last_unstale":"2024-09-21T01:49:41.737699+0000","last_undegraded":"2024-09-21T01:49:41.737699+0000","last_fullsized":"2024-09-21T01:49:41.737699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:17.764196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353693+0000","last_change":"2024-09-21T01:49:40.352821+0000","last_active":"2024-09-21T01:49:41.353693+0000","last_peered":"2024-09-21T01:49:41.353693+0000","last_clean":"2024-09-21T01:49:41.353693+0000","last_became_active":"2024-09-21T01:49:40.351889+0000","last_became_peered":"2024-09-21T01:49:40.351889+0000","last_unstale":"2024-09-21T01:49:41.353693+0000","last_undegraded":"2024-09-21T01:49:41.353693+0000","last_fullsized":"2024-09-21T01:49:41.353693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:05.023859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736502+0000","last_change":"2024-09-21T01:49:39.351127+0000","last_active":"2024-09-21T01:49:41.736502+0000","last_peered":"2024-09-21T01:49:41.736502+0000","last_clean":"2024-09-21T01:49:41.736502+0000","last_became_active":"2024-09-21T01:49:39.350783+0000","last_became_peered":"2024-09-21T01:49:39.350783+0000","last_unstale":"2024-09-21T01:49:41.736502+0000","last_undegraded":"2024-09-21T01:49:41.736502+0000","last_fullsized":"2024-09-21T01:49:41.736502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:42.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737434+0000","last_change":"2024-09-21T01:49:40.368882+0000","last_active":"2024-09-21T01:49:41.737434+0000","last_peered":"2024-09-21T01:49:41.737434+0000","last_clean":"2024-09-21T01:49:41.737434+0000","last_became_active":"2024-09-21T01:49:40.367820+0000","last_became_peered":"2024-09-21T01:49:40.367820+0000","last_unstale":"2024-09-21T01:49:41.737434+0000","last_undegraded":"2024-09-21T01:49:41.737434+0000","last_fullsized":"2024-09-21T01:49:41.737434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:45.001295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737894+0000","last_change":"2024-09-21T01:49:39.356508+0000","last_active":"2024-09-21T01:49:41.737894+0000","last_peered":"2024-09-21T01:49:41.737894+0000","last_clean":"2024-09-21T01:49:41.737894+0000","last_became_active":"2024-09-21T01:49:39.356169+0000","last_became_peered":"2024-09-21T01:49:39.356169+0000","last_unstale":"2024-09-21T01:49:41.737894+0000","last_undegraded":"2024-09-21T01:49:41.737894+0000","last_fullsized":"2024-09-21T01:49:41.737894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:52.672165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736513+0000","last_change":"2024-09-21T01:49:40.351790+0000","last_active":"2024-09-21T01:49:41.736513+0000","last_peered":"2024-09-21T01:49:41.736513+0000","last_clean":"2024-09-21T01:49:41.736513+0000","last_became_active":"2024-09-21T01:49:40.351392+0000","last_became_peered":"2024-09-21T01:49:40.351392+0000","last_unstale":"2024-09-21T01:49:41.736513+0000","last_undegraded":"2024-09-21T01:49:41.736513+0000","last_fullsized":"2024-09-21T01:49:41.736513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:45.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:42.340972+0000","last_change":"2024-09-21T01:49:39.353294+0000","last_active":"2024-09-21T01:49:42.340972+0000","last_peered":"2024-09-21T01:49:42.340972+0000","last_clean":"2024-09-21T01:49:42.340972+0000","last_became_active":"2024-09-21T01:49:39.352984+0000","last_became_peered":"2024-09-21T01:49:39.352984+0000","last_unstale":"2024-09-21T01:49:42.340972+0000","last_undegraded":"2024-09-21T01:49:42.340972+0000","last_fullsized":"2024-09-21T01:49:42.340972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:31.319877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351908+0000","last_change":"2024-09-21T01:49:40.351451+0000","last_active":"2024-09-21T01:49:41.351908+0000","last_peered":"2024-09-21T01:49:41.351908+0000","last_clean":"2024-09-21T01:49:41.351908+0000","last_became_active":"2024-09-21T01:49:40.351100+0000","last_became_peered":"2024-09-21T01:49:40.351100+0000","last_unstale":"2024-09-21T01:49:41.351908+0000","last_undegraded":"2024-09-21T01:49:41.351908+0000","last_fullsized":"2024-09-21T01:49:41.351908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:15.787679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535436+0000","last_change":"2024-09-21T01:49:39.353205+0000","last_active":"2024-09-21T01:49:41.535436+0000","last_peered":"2024-09-21T01:49:41.535436+0000","last_clean":"2024-09-21T01:49:41.535436+0000","last_became_active":"2024-09-21T01:49:39.352858+0000","last_became_peered":"2024-09-21T01:49:39.352858+0000","last_unstale":"2024-09-21T01:49:41.535436+0000","last_undegraded":"2024-09-21T01:49:41.535436+0000","last_fullsized":"2024-09-21T01:49:41.535436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:35.086866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350768+0000","last_change":"2024-09-21T01:49:40.354056+0000","last_active":"2024-09-21T01:49:41.350768+0000","last_peered":"2024-09-21T01:49:41.350768+0000","last_clean":"2024-09-21T01:49:41.350768+0000","last_became_active":"2024-09-21T01:49:40.353701+0000","last_became_peered":"2024-09-21T01:49:40.353701+0000","last_unstale":"2024-09-21T01:49:41.350768+0000","last_undegraded":"2024-09-21T01:49:41.350768+0000","last_fullsized":"2024-09-21T01:49:41.350768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:36.817174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736561+0000","last_change":"2024-09-21T01:49:39.355387+0000","last_active":"2024-09-21T01:49:41.736561+0000","last_peered":"2024-09-21T01:49:41.736561+0000","last_clean":"2024-09-21T01:49:41.736561+0000","last_became_active":"2024-09-21T01:49:39.355048+0000","last_became_peered":"2024-09-21T01:49:39.355048+0000","last_unstale":"2024-09-21T01:49:41.736561+0000","last_undegraded":"2024-09-21T01:49:41.736561+0000","last_fullsized":"2024-09-21T01:49:41.736561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:27.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353474+0000","last_change":"2024-09-21T01:49:40.351959+0000","last_active":"2024-09-21T01:49:41.353474+0000","last_peered":"2024-09-21T01:49:41.353474+0000","last_clean":"2024-09-21T01:49:41.353474+0000","last_became_active":"2024-09-21T01:49:40.351308+0000","last_became_peered":"2024-09-21T01:49:40.351308+0000","last_unstale":"2024-09-21T01:49:41.353474+0000","last_undegraded":"2024-09-21T01:49:41.353474+0000","last_fullsized":"2024-09-21T01:49:41.353474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:28.397512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736277+0000","last_change":"2024-09-21T01:49:39.350179+0000","last_active":"2024-09-21T01:49:41.736277+0000","last_peered":"2024-09-21T01:49:41.736277+0000","last_clean":"2024-09-21T01:49:41.736277+0000","last_became_active":"2024-09-21T01:49:39.347968+0000","last_became_peered":"2024-09-21T01:49:39.347968+0000","last_unstale":"2024-09-21T01:49:41.736277+0000","last_undegraded":"2024-09-21T01:49:41.736277+0000","last_fullsized":"2024-09-21T01:49:41.736277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352083+0000","last_change":"2024-09-21T01:49:40.354991+0000","last_active":"2024-09-21T01:49:41.352083+0000","last_peered":"2024-09-21T01:49:41.352083+0000","last_clean":"2024-09-21T01:49:41.352083+0000","last_became_active":"2024-09-21T01:49:40.352773+0000","last_became_peered":"2024-09-21T01:49:40.352773+0000","last_unstale":"2024-09-21T01:49:41.352083+0000","last_undegraded":"2024-09-21T01:49:41.352083+0000","last_fullsized":"2024-09-21T01:49:41.352083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:26.545436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736233+0000","last_change":"2024-09-21T01:49:39.349158+0000","last_active":"2024-09-21T01:49:41.736233+0000","last_peered":"2024-09-21T01:49:41.736233+0000","last_clean":"2024-09-21T01:49:41.736233+0000","last_became_active":"2024-09-21T01:49:39.347821+0000","last_became_peered":"2024-09-21T01:49:39.347821+0000","last_unstale":"2024-09-21T01:49:41.736233+0000","last_undegraded":"2024-09-21T01:49:41.736233+0000","last_fullsized":"2024-09-21T01:49:41.736233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:02.187963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352318+0000","last_change":"2024-09-21T01:49:40.355562+0000","last_active":"2024-09-21T01:49:41.352318+0000","last_peered":"2024-09-21T01:49:41.352318+0000","last_clean":"2024-09-21T01:49:41.352318+0000","last_became_active":"2024-09-21T01:49:40.354546+0000","last_became_peered":"2024-09-21T01:49:40.354546+0000","last_unstale":"2024-09-21T01:49:41.352318+0000","last_undegraded":"2024-09-21T01:49:41.352318+0000","last_fullsized":"2024-09-21T01:49:41.352318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:52.645109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737751+0000","last_change":"2024-09-21T01:49:39.358033+0000","last_active":"2024-09-21T01:49:41.737751+0000","last_peered":"2024-09-21T01:49:41.737751+0000","last_clean":"2024-09-21T01:49:41.737751+0000","last_became_active":"2024-09-21T01:49:39.357680+0000","last_became_peered":"2024-09-21T01:49:39.357680+0000","last_unstale":"2024-09-21T01:49:41.737751+0000","last_undegraded":"2024-09-21T01:49:41.737751+0000","last_fullsized":"2024-09-21T01:49:41.737751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:09:19.831260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535186+0000","last_change":"2024-09-21T01:49:40.365613+0000","last_active":"2024-09-21T01:49:41.535186+0000","last_peered":"2024-09-21T01:49:41.535186+0000","last_clean":"2024-09-21T01:49:41.535186+0000","last_became_active":"2024-09-21T01:49:40.365297+0000","last_became_peered":"2024-09-21T01:49:40.365297+0000","last_unstale":"2024-09-21T01:49:41.535186+0000","last_undegraded":"2024-09-21T01:49:41.535186+0000","last_fullsized":"2024-09-21T01:49:41.535186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.999168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736952+0000","last_change":"2024-09-21T01:49:40.367268+0000","last_active":"2024-09-21T01:49:41.736952+0000","last_peered":"2024-09-21T01:49:41.736952+0000","last_clean":"2024-09-21T01:49:41.736952+0000","last_became_active":"2024-09-21T01:49:40.366946+0000","last_became_peered":"2024-09-21T01:49:40.366946+0000","last_unstale":"2024-09-21T01:49:41.736952+0000","last_undegraded":"2024-09-21T01:49:41.736952+0000","last_fullsized":"2024-09-21T01:49:41.736952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:29.301249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736693+0000","last_change":"2024-09-21T01:49:39.359266+0000","last_active":"2024-09-21T01:49:41.736693+0000","last_peered":"2024-09-21T01:49:41.736693+0000","last_clean":"2024-09-21T01:49:41.736693+0000","last_became_active":"2024-09-21T01:49:39.358350+0000","last_became_peered":"2024-09-21T01:49:39.358350+0000","last_unstale":"2024-09-21T01:49:41.736693+0000","last_undegraded":"2024-09-21T01:49:41.736693+0000","last_fullsized":"2024-09-21T01:49:41.736693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:43.979023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737278+0000","last_change":"2024-09-21T01:49:40.367875+0000","last_active":"2024-09-21T01:49:41.737278+0000","last_peered":"2024-09-21T01:49:41.737278+0000","last_clean":"2024-09-21T01:49:41.737278+0000","last_became_active":"2024-09-21T01:49:40.367529+0000","last_became_peered":"2024-09-21T01:49:40.367529+0000","last_unstale":"2024-09-21T01:49:41.737278+0000","last_undegraded":"2024-09-21T01:49:41.737278+0000","last_fullsized":"2024-09-21T01:49:41.737278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:17.573511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737423+0000","last_change":"2024-09-21T01:49:39.359628+0000","last_active":"2024-09-21T01:49:41.737423+0000","last_peered":"2024-09-21T01:49:41.737423+0000","last_clean":"2024-09-21T01:49:41.737423+0000","last_became_active":"2024-09-21T01:49:39.359209+0000","last_became_peered":"2024-09-21T01:49:39.359209+0000","last_unstale":"2024-09-21T01:49:41.737423+0000","last_undegraded":"2024-09-21T01:49:41.737423+0000","last_fullsized":"2024-09-21T01:49:41.737423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:04.017652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350648+0000","last_change":"2024-09-21T01:49:40.364917+0000","last_active":"2024-09-21T01:49:41.350648+0000","last_peered":"2024-09-21T01:49:41.350648+0000","last_clean":"2024-09-21T01:49:41.350648+0000","last_became_active":"2024-09-21T01:49:40.364166+0000","last_became_peered":"2024-09-21T01:49:40.364166+0000","last_unstale":"2024-09-21T01:49:41.350648+0000","last_undegraded":"2024-09-21T01:49:41.350648+0000","last_fullsized":"2024-09-21T01:49:41.350648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:08.726343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351636+0000","last_change":"2024-09-21T01:49:39.356150+0000","last_active":"2024-09-21T01:49:41.351636+0000","last_peered":"2024-09-21T01:49:41.351636+0000","last_clean":"2024-09-21T01:49:41.351636+0000","last_became_active":"2024-09-21T01:49:39.355548+0000","last_became_peered":"2024-09-21T01:49:39.355548+0000","last_unstale":"2024-09-21T01:49:41.351636+0000","last_undegraded":"2024-09-21T01:49:41.351636+0000","last_fullsized":"2024-09-21T01:49:41.351636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:02.371670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351655+0000","last_change":"2024-09-21T01:49:40.357471+0000","last_active":"2024-09-21T01:49:41.351655+0000","last_peered":"2024-09-21T01:49:41.351655+0000","last_clean":"2024-09-21T01:49:41.351655+0000","last_became_active":"2024-09-21T01:49:40.357158+0000","last_became_peered":"2024-09-21T01:49:40.357158+0000","last_unstale":"2024-09-21T01:49:41.351655+0000","last_undegraded":"2024-09-21T01:49:41.351655+0000","last_fullsized":"2024-09-21T01:49:41.351655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:22:28.048336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350824+0000","last_change":"2024-09-21T01:49:39.354483+0000","last_active":"2024-09-21T01:49:41.350824+0000","last_peered":"2024-09-21T01:49:41.350824+0000","last_clean":"2024-09-21T01:49:41.350824+0000","last_became_active":"2024-09-21T01:49:39.354167+0000","last_became_peered":"2024-09-21T01:49:39.354167+0000","last_unstale":"2024-09-21T01:49:41.350824+0000","last_undegraded":"2024-09-21T01:49:41.350824+0000","last_fullsized":"2024-09-21T01:49:41.350824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:08:48.875745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":662973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:49:46.319 INFO:tasks.ceph.mds.b.smithi139.stderr:2024-09-21T01:49:46.318+0000 7f5106b53640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T01:49:48.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:49:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.068+0000 7fa3a087f640 1 -- 172.21.15.40:0/1131975947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384003fd0 msgr2=0x7fa384004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.068+0000 7fa3a087f640 1 --2- 172.21.15.40:0/1131975947 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384003fd0 0x7fa384004800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa39c08ee10 tx=0x7fa384005830 comp rx=0 tx=0).stop 2024-09-21T01:49:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.068+0000 7fa39ad9d640 1 -- 172.21.15.40:0/1131975947 reap_dead start 2024-09-21T01:49:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.069+0000 7fa3a087f640 1 -- 172.21.15.40:0/1131975947 shutdown_connections 2024-09-21T01:49:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.069+0000 7fa3a087f640 1 -- 172.21.15.40:0/1131975947 >> 172.21.15.40:0/1131975947 conn(0x7fa39c09d8f0 msgr2=0x7fa39c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.069+0000 7fa3a087f640 1 -- 172.21.15.40:0/1131975947 shutdown_connections 2024-09-21T01:49:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.069+0000 7fa3a087f640 1 -- 172.21.15.40:0/1131975947 wait complete. 2024-09-21T01:49:49.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.071+0000 7fa3a087f640 1 Processor -- start 2024-09-21T01:49:49.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.071+0000 7fa3a087f640 1 -- start start 2024-09-21T01:49:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa3a087f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384003fd0 0x7fa39c157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa3a087f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa39c0ca010 0x7fa39c0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa3a087f640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa39c160c90 0x7fa39c1610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa3a087f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa39c0d1fa0 con 0x7fa384003fd0 2024-09-21T01:49:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa3a087f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa39c163080 con 0x7fa39c0ca010 2024-09-21T01:49:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa3a087f640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fa39c1583f0 con 0x7fa39c160c90 2024-09-21T01:49:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa39a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384003fd0 0x7fa39c157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa39a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384003fd0 0x7fa39c157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50884/0 (socket says 172.21.15.40:50884) 2024-09-21T01:49:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa39a59c640 1 -- 172.21.15.40:0/1940489127 learned_addr learned my addr 172.21.15.40:0/1940489127 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa39ad9d640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa39c160c90 0x7fa39c1610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa399d9b640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa39c0ca010 0x7fa39c0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa39a59c640 1 -- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa39c160c90 msgr2=0x7fa39c1610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa39a59c640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa39c160c90 0x7fa39c1610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa39a59c640 1 -- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa39c0ca010 msgr2=0x7fa39c0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa39a59c640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa39c0ca010 0x7fa39c0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.072+0000 7fa39a59c640 1 -- 172.21.15.40:0/1940489127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39c0c9250 con 0x7fa384003fd0 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.073+0000 7fa39a59c640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384003fd0 0x7fa39c157eb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa38c011b10 tx=0x7fa38c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.073+0000 7fa38affd640 1 -- 172.21.15.40:0/1940489127 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c01e070 con 0x7fa384003fd0 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.073+0000 7fa38affd640 1 -- 172.21.15.40:0/1940489127 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa38c004050 con 0x7fa384003fd0 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.073+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39c0c9530 con 0x7fa384003fd0 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.073+0000 7fa38affd640 1 -- 172.21.15.40:0/1940489127 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00fea0 con 0x7fa384003fd0 2024-09-21T01:49:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.073+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa39c1554e0 con 0x7fa384003fd0 2024-09-21T01:49:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.074+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa39c0d1170 con 0x7fa384003fd0 2024-09-21T01:49:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.075+0000 7fa38affd640 1 -- 172.21.15.40:0/1940489127 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa38c021070 con 0x7fa384003fd0 2024-09-21T01:49:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.075+0000 7fa38affd640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa37c078b90 0x7fa37c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.075+0000 7fa38affd640 1 -- 172.21.15.40:0/1940489127 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa38c09b790 con 0x7fa384003fd0 2024-09-21T01:49:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.076+0000 7fa399d9b640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa37c078b90 0x7fa37c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.076+0000 7fa399d9b640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa37c078b90 0x7fa37c07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa384004780 tx=0x7fa390001c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.080+0000 7fa38affd640 1 -- 172.21.15.40:0/1940489127 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa38c0044a0 con 0x7fa384003fd0 2024-09-21T01:49:49.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.264+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 --> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa39c0b6600 con 0x7fa37c078b90 2024-09-21T01:49:49.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.269+0000 7fa38affd640 1 -- 172.21.15.40:0/1940489127 <== mgr.4100 v2:172.21.15.139:6800/852736644 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7fa39c0b6600 con 0x7fa37c078b90 2024-09-21T01:49:49.273 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:49.274 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-21T01:49:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.271+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa37c078b90 msgr2=0x7fa37c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.271+0000 7fa3a087f640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa37c078b90 0x7fa37c07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa384004780 tx=0x7fa390001c00 comp rx=0 tx=0).stop 2024-09-21T01:49:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.271+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384003fd0 msgr2=0x7fa39c157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.271+0000 7fa3a087f640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384003fd0 0x7fa39c157eb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa38c011b10 tx=0x7fa38c009e90 comp rx=0 tx=0).stop 2024-09-21T01:49:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.272+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 shutdown_connections 2024-09-21T01:49:49.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.272+0000 7fa3a087f640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa37c078b90 0x7fa37c07b0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.272+0000 7fa3a087f640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa39c160c90 0x7fa39c1610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.272+0000 7fa3a087f640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa39c0ca010 0x7fa39c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.272+0000 7fa3a087f640 1 --2- 172.21.15.40:0/1940489127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa384003fd0 0x7fa39c157eb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.272+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 >> 172.21.15.40:0/1940489127 conn(0x7fa39c09d8f0 msgr2=0x7fa39c154630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.272+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 shutdown_connections 2024-09-21T01:49:49.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.272+0000 7fa3a087f640 1 -- 172.21.15.40:0/1940489127 wait complete. 2024-09-21T01:49:49.284 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-21T01:49:47.310840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2924544,"data_stored":1761292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.977785"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737960+0000","last_change":"2024-09-21T01:49:40.356030+0000","last_active":"2024-09-21T01:49:41.737960+0000","last_peered":"2024-09-21T01:49:41.737960+0000","last_clean":"2024-09-21T01:49:41.737960+0000","last_became_active":"2024-09-21T01:49:40.355677+0000","last_became_peered":"2024-09-21T01:49:40.355677+0000","last_unstale":"2024-09-21T01:49:41.737960+0000","last_undegraded":"2024-09-21T01:49:41.737960+0000","last_fullsized":"2024-09-21T01:49:41.737960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:57.340502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736421+0000","last_change":"2024-09-21T01:49:40.366361+0000","last_active":"2024-09-21T01:49:41.736421+0000","last_peered":"2024-09-21T01:49:41.736421+0000","last_clean":"2024-09-21T01:49:41.736421+0000","last_became_active":"2024-09-21T01:49:40.366008+0000","last_became_peered":"2024-09-21T01:49:40.366008+0000","last_unstale":"2024-09-21T01:49:41.736421+0000","last_undegraded":"2024-09-21T01:49:41.736421+0000","last_fullsized":"2024-09-21T01:49:41.736421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:30.129619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350613+0000","last_change":"2024-09-21T01:49:40.349571+0000","last_active":"2024-09-21T01:49:41.350613+0000","last_peered":"2024-09-21T01:49:41.350613+0000","last_clean":"2024-09-21T01:49:41.350613+0000","last_became_active":"2024-09-21T01:49:40.349241+0000","last_became_peered":"2024-09-21T01:49:40.349241+0000","last_unstale":"2024-09-21T01:49:41.350613+0000","last_undegraded":"2024-09-21T01:49:41.350613+0000","last_fullsized":"2024-09-21T01:49:41.350613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.999168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736794+0000","last_change":"2024-09-21T01:49:40.372236+0000","last_active":"2024-09-21T01:49:41.736794+0000","last_peered":"2024-09-21T01:49:41.736794+0000","last_clean":"2024-09-21T01:49:41.736794+0000","last_became_active":"2024-09-21T01:49:40.371944+0000","last_became_peered":"2024-09-21T01:49:40.371944+0000","last_unstale":"2024-09-21T01:49:41.736794+0000","last_undegraded":"2024-09-21T01:49:41.736794+0000","last_fullsized":"2024-09-21T01:49:41.736794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:26.563781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737255+0000","last_change":"2024-09-21T01:49:40.358244+0000","last_active":"2024-09-21T01:49:41.737255+0000","last_peered":"2024-09-21T01:49:41.737255+0000","last_clean":"2024-09-21T01:49:41.737255+0000","last_became_active":"2024-09-21T01:49:40.357953+0000","last_became_peered":"2024-09-21T01:49:40.357953+0000","last_unstale":"2024-09-21T01:49:41.737255+0000","last_undegraded":"2024-09-21T01:49:41.737255+0000","last_fullsized":"2024-09-21T01:49:41.737255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:52.645109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736458+0000","last_change":"2024-09-21T01:49:40.370563+0000","last_active":"2024-09-21T01:49:41.736458+0000","last_peered":"2024-09-21T01:49:41.736458+0000","last_clean":"2024-09-21T01:49:41.736458+0000","last_became_active":"2024-09-21T01:49:40.369831+0000","last_became_peered":"2024-09-21T01:49:40.369831+0000","last_unstale":"2024-09-21T01:49:41.736458+0000","last_undegraded":"2024-09-21T01:49:41.736458+0000","last_fullsized":"2024-09-21T01:49:41.736458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736598+0000","last_change":"2024-09-21T01:49:40.364668+0000","last_active":"2024-09-21T01:49:41.736598+0000","last_peered":"2024-09-21T01:49:41.736598+0000","last_clean":"2024-09-21T01:49:41.736598+0000","last_became_active":"2024-09-21T01:49:40.363159+0000","last_became_peered":"2024-09-21T01:49:40.363159+0000","last_unstale":"2024-09-21T01:49:41.736598+0000","last_undegraded":"2024-09-21T01:49:41.736598+0000","last_fullsized":"2024-09-21T01:49:41.736598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:36.062812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351404+0000","last_change":"2024-09-21T01:49:40.363639+0000","last_active":"2024-09-21T01:49:41.351404+0000","last_peered":"2024-09-21T01:49:41.351404+0000","last_clean":"2024-09-21T01:49:41.351404+0000","last_became_active":"2024-09-21T01:49:40.363291+0000","last_became_peered":"2024-09-21T01:49:40.363291+0000","last_unstale":"2024-09-21T01:49:41.351404+0000","last_undegraded":"2024-09-21T01:49:41.351404+0000","last_fullsized":"2024-09-21T01:49:41.351404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:03.841294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737999+0000","last_change":"2024-09-21T01:49:40.366167+0000","last_active":"2024-09-21T01:49:41.737999+0000","last_peered":"2024-09-21T01:49:41.737999+0000","last_clean":"2024-09-21T01:49:41.737999+0000","last_became_active":"2024-09-21T01:49:40.364598+0000","last_became_peered":"2024-09-21T01:49:40.364598+0000","last_unstale":"2024-09-21T01:49:41.737999+0000","last_undegraded":"2024-09-21T01:49:41.737999+0000","last_fullsized":"2024-09-21T01:49:41.737999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:36.012884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535590+0000","last_change":"2024-09-21T01:49:40.368687+0000","last_active":"2024-09-21T01:49:41.535590+0000","last_peered":"2024-09-21T01:49:41.535590+0000","last_clean":"2024-09-21T01:49:41.535590+0000","last_became_active":"2024-09-21T01:49:40.366584+0000","last_became_peered":"2024-09-21T01:49:40.366584+0000","last_unstale":"2024-09-21T01:49:41.535590+0000","last_undegraded":"2024-09-21T01:49:41.535590+0000","last_fullsized":"2024-09-21T01:49:41.535590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535321+0000","last_change":"2024-09-21T01:49:40.358569+0000","last_active":"2024-09-21T01:49:41.535321+0000","last_peered":"2024-09-21T01:49:41.535321+0000","last_clean":"2024-09-21T01:49:41.535321+0000","last_became_active":"2024-09-21T01:49:40.358189+0000","last_became_peered":"2024-09-21T01:49:40.358189+0000","last_unstale":"2024-09-21T01:49:41.535321+0000","last_undegraded":"2024-09-21T01:49:41.535321+0000","last_fullsized":"2024-09-21T01:49:41.535321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.668625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353509+0000","last_change":"2024-09-21T01:49:40.360227+0000","last_active":"2024-09-21T01:49:41.353509+0000","last_peered":"2024-09-21T01:49:41.353509+0000","last_clean":"2024-09-21T01:49:41.353509+0000","last_became_active":"2024-09-21T01:49:40.359457+0000","last_became_peered":"2024-09-21T01:49:40.359457+0000","last_unstale":"2024-09-21T01:49:41.353509+0000","last_undegraded":"2024-09-21T01:49:41.353509+0000","last_fullsized":"2024-09-21T01:49:41.353509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:44.985230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352280+0000","last_change":"2024-09-21T01:49:40.356310+0000","last_active":"2024-09-21T01:49:41.352280+0000","last_peered":"2024-09-21T01:49:41.352280+0000","last_clean":"2024-09-21T01:49:41.352280+0000","last_became_active":"2024-09-21T01:49:40.356004+0000","last_became_peered":"2024-09-21T01:49:40.356004+0000","last_unstale":"2024-09-21T01:49:41.352280+0000","last_undegraded":"2024-09-21T01:49:41.352280+0000","last_fullsized":"2024-09-21T01:49:41.352280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:14.949645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350350+0000","last_change":"2024-09-21T01:49:40.354886+0000","last_active":"2024-09-21T01:49:41.350350+0000","last_peered":"2024-09-21T01:49:41.350350+0000","last_clean":"2024-09-21T01:49:41.350350+0000","last_became_active":"2024-09-21T01:49:40.354489+0000","last_became_peered":"2024-09-21T01:49:40.354489+0000","last_unstale":"2024-09-21T01:49:41.350350+0000","last_undegraded":"2024-09-21T01:49:41.350350+0000","last_fullsized":"2024-09-21T01:49:41.350350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:43.940906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736359+0000","last_change":"2024-09-21T01:49:40.364466+0000","last_active":"2024-09-21T01:49:41.736359+0000","last_peered":"2024-09-21T01:49:41.736359+0000","last_clean":"2024-09-21T01:49:41.736359+0000","last_became_active":"2024-09-21T01:49:40.364098+0000","last_became_peered":"2024-09-21T01:49:40.364098+0000","last_unstale":"2024-09-21T01:49:41.736359+0000","last_undegraded":"2024-09-21T01:49:41.736359+0000","last_fullsized":"2024-09-21T01:49:41.736359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:24.593410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736538+0000","last_change":"2024-09-21T01:49:40.370361+0000","last_active":"2024-09-21T01:49:41.736538+0000","last_peered":"2024-09-21T01:49:41.736538+0000","last_clean":"2024-09-21T01:49:41.736538+0000","last_became_active":"2024-09-21T01:49:40.370046+0000","last_became_peered":"2024-09-21T01:49:40.370046+0000","last_unstale":"2024-09-21T01:49:41.736538+0000","last_undegraded":"2024-09-21T01:49:41.736538+0000","last_fullsized":"2024-09-21T01:49:41.736538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:35.506009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737746+0000","last_change":"2024-09-21T01:49:40.364197+0000","last_active":"2024-09-21T01:49:41.737746+0000","last_peered":"2024-09-21T01:49:41.737746+0000","last_clean":"2024-09-21T01:49:41.737746+0000","last_became_active":"2024-09-21T01:49:40.363906+0000","last_became_peered":"2024-09-21T01:49:40.363906+0000","last_unstale":"2024-09-21T01:49:41.737746+0000","last_undegraded":"2024-09-21T01:49:41.737746+0000","last_fullsized":"2024-09-21T01:49:41.737746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:40.514781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736268+0000","last_change":"2024-09-21T01:49:40.369575+0000","last_active":"2024-09-21T01:49:41.736268+0000","last_peered":"2024-09-21T01:49:41.736268+0000","last_clean":"2024-09-21T01:49:41.736268+0000","last_became_active":"2024-09-21T01:49:40.369160+0000","last_became_peered":"2024-09-21T01:49:40.369160+0000","last_unstale":"2024-09-21T01:49:41.736268+0000","last_undegraded":"2024-09-21T01:49:41.736268+0000","last_fullsized":"2024-09-21T01:49:41.736268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:32.326084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737961+0000","last_change":"2024-09-21T01:49:40.357275+0000","last_active":"2024-09-21T01:49:41.737961+0000","last_peered":"2024-09-21T01:49:41.737961+0000","last_clean":"2024-09-21T01:49:41.737961+0000","last_became_active":"2024-09-21T01:49:40.356956+0000","last_became_peered":"2024-09-21T01:49:40.356956+0000","last_unstale":"2024-09-21T01:49:41.737961+0000","last_undegraded":"2024-09-21T01:49:41.737961+0000","last_fullsized":"2024-09-21T01:49:41.737961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:09.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535522+0000","last_change":"2024-09-21T01:49:40.366142+0000","last_active":"2024-09-21T01:49:41.535522+0000","last_peered":"2024-09-21T01:49:41.535522+0000","last_clean":"2024-09-21T01:49:41.535522+0000","last_became_active":"2024-09-21T01:49:40.365863+0000","last_became_peered":"2024-09-21T01:49:40.365863+0000","last_unstale":"2024-09-21T01:49:41.535522+0000","last_undegraded":"2024-09-21T01:49:41.535522+0000","last_fullsized":"2024-09-21T01:49:41.535522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:24.814662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350661+0000","last_change":"2024-09-21T01:49:40.350221+0000","last_active":"2024-09-21T01:49:41.350661+0000","last_peered":"2024-09-21T01:49:41.350661+0000","last_clean":"2024-09-21T01:49:41.350661+0000","last_became_active":"2024-09-21T01:49:40.349898+0000","last_became_peered":"2024-09-21T01:49:40.349898+0000","last_unstale":"2024-09-21T01:49:41.350661+0000","last_undegraded":"2024-09-21T01:49:41.350661+0000","last_fullsized":"2024-09-21T01:49:41.350661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:12.766064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737119+0000","last_change":"2024-09-21T01:49:40.370844+0000","last_active":"2024-09-21T01:49:41.737119+0000","last_peered":"2024-09-21T01:49:41.737119+0000","last_clean":"2024-09-21T01:49:41.737119+0000","last_became_active":"2024-09-21T01:49:40.369354+0000","last_became_peered":"2024-09-21T01:49:40.369354+0000","last_unstale":"2024-09-21T01:49:41.737119+0000","last_undegraded":"2024-09-21T01:49:41.737119+0000","last_fullsized":"2024-09-21T01:49:41.737119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.916601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351626+0000","last_change":"2024-09-21T01:49:40.352293+0000","last_active":"2024-09-21T01:49:41.351626+0000","last_peered":"2024-09-21T01:49:41.351626+0000","last_clean":"2024-09-21T01:49:41.351626+0000","last_became_active":"2024-09-21T01:49:40.351973+0000","last_became_peered":"2024-09-21T01:49:40.351973+0000","last_unstale":"2024-09-21T01:49:41.351626+0000","last_undegraded":"2024-09-21T01:49:41.351626+0000","last_fullsized":"2024-09-21T01:49:41.351626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:12.766064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736452+0000","last_change":"2024-09-21T01:49:40.371534+0000","last_active":"2024-09-21T01:49:41.736452+0000","last_peered":"2024-09-21T01:49:41.736452+0000","last_clean":"2024-09-21T01:49:41.736452+0000","last_became_active":"2024-09-21T01:49:40.371235+0000","last_became_peered":"2024-09-21T01:49:40.371235+0000","last_unstale":"2024-09-21T01:49:41.736452+0000","last_undegraded":"2024-09-21T01:49:41.736452+0000","last_fullsized":"2024-09-21T01:49:41.736452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351780+0000","last_change":"2024-09-21T01:49:40.361289+0000","last_active":"2024-09-21T01:49:41.351780+0000","last_peered":"2024-09-21T01:49:41.351780+0000","last_clean":"2024-09-21T01:49:41.351780+0000","last_became_active":"2024-09-21T01:49:40.360952+0000","last_became_peered":"2024-09-21T01:49:40.360952+0000","last_unstale":"2024-09-21T01:49:41.351780+0000","last_undegraded":"2024-09-21T01:49:41.351780+0000","last_fullsized":"2024-09-21T01:49:41.351780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:58.888642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535608+0000","last_change":"2024-09-21T01:49:40.356406+0000","last_active":"2024-09-21T01:49:41.535608+0000","last_peered":"2024-09-21T01:49:41.535608+0000","last_clean":"2024-09-21T01:49:41.535608+0000","last_became_active":"2024-09-21T01:49:40.355941+0000","last_became_peered":"2024-09-21T01:49:40.355941+0000","last_unstale":"2024-09-21T01:49:41.535608+0000","last_undegraded":"2024-09-21T01:49:41.535608+0000","last_fullsized":"2024-09-21T01:49:41.535608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736560+0000","last_change":"2024-09-21T01:49:40.354384+0000","last_active":"2024-09-21T01:49:41.736560+0000","last_peered":"2024-09-21T01:49:41.736560+0000","last_clean":"2024-09-21T01:49:41.736560+0000","last_became_active":"2024-09-21T01:49:40.354065+0000","last_became_peered":"2024-09-21T01:49:40.354065+0000","last_unstale":"2024-09-21T01:49:41.736560+0000","last_undegraded":"2024-09-21T01:49:41.736560+0000","last_fullsized":"2024-09-21T01:49:41.736560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:43.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352248+0000","last_change":"2024-09-21T01:49:40.347679+0000","last_active":"2024-09-21T01:49:41.352248+0000","last_peered":"2024-09-21T01:49:41.352248+0000","last_clean":"2024-09-21T01:49:41.352248+0000","last_became_active":"2024-09-21T01:49:40.347302+0000","last_became_peered":"2024-09-21T01:49:40.347302+0000","last_unstale":"2024-09-21T01:49:41.352248+0000","last_undegraded":"2024-09-21T01:49:41.352248+0000","last_fullsized":"2024-09-21T01:49:41.352248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:00.866709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351058+0000","last_change":"2024-09-21T01:49:40.351144+0000","last_active":"2024-09-21T01:49:41.351058+0000","last_peered":"2024-09-21T01:49:41.351058+0000","last_clean":"2024-09-21T01:49:41.351058+0000","last_became_active":"2024-09-21T01:49:40.350778+0000","last_became_peered":"2024-09-21T01:49:40.350778+0000","last_unstale":"2024-09-21T01:49:41.351058+0000","last_undegraded":"2024-09-21T01:49:41.351058+0000","last_fullsized":"2024-09-21T01:49:41.351058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737667+0000","last_change":"2024-09-21T01:49:40.372249+0000","last_active":"2024-09-21T01:49:41.737667+0000","last_peered":"2024-09-21T01:49:41.737667+0000","last_clean":"2024-09-21T01:49:41.737667+0000","last_became_active":"2024-09-21T01:49:40.371920+0000","last_became_peered":"2024-09-21T01:49:40.371920+0000","last_unstale":"2024-09-21T01:49:41.737667+0000","last_undegraded":"2024-09-21T01:49:41.737667+0000","last_fullsized":"2024-09-21T01:49:41.737667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:57.340502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735902+0000","last_change":"2024-09-21T01:49:40.365077+0000","last_active":"2024-09-21T01:49:41.735902+0000","last_peered":"2024-09-21T01:49:41.735902+0000","last_clean":"2024-09-21T01:49:41.735902+0000","last_became_active":"2024-09-21T01:49:40.364475+0000","last_became_peered":"2024-09-21T01:49:40.364475+0000","last_unstale":"2024-09-21T01:49:41.735902+0000","last_undegraded":"2024-09-21T01:49:41.735902+0000","last_fullsized":"2024-09-21T01:49:41.735902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:16.394801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535444+0000","last_change":"2024-09-21T01:49:40.364957+0000","last_active":"2024-09-21T01:49:41.535444+0000","last_peered":"2024-09-21T01:49:41.535444+0000","last_clean":"2024-09-21T01:49:41.535444+0000","last_became_active":"2024-09-21T01:49:40.363773+0000","last_became_peered":"2024-09-21T01:49:40.363773+0000","last_unstale":"2024-09-21T01:49:41.535444+0000","last_undegraded":"2024-09-21T01:49:41.535444+0000","last_fullsized":"2024-09-21T01:49:41.535444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:36.817174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353667+0000","last_change":"2024-09-21T01:49:40.362548+0000","last_active":"2024-09-21T01:49:41.353667+0000","last_peered":"2024-09-21T01:49:41.353667+0000","last_clean":"2024-09-21T01:49:41.353667+0000","last_became_active":"2024-09-21T01:49:40.362006+0000","last_became_peered":"2024-09-21T01:49:40.362006+0000","last_unstale":"2024-09-21T01:49:41.353667+0000","last_undegraded":"2024-09-21T01:49:41.353667+0000","last_fullsized":"2024-09-21T01:49:41.353667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:09:20.837466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352351+0000","last_change":"2024-09-21T01:49:39.354635+0000","last_active":"2024-09-21T01:49:41.352351+0000","last_peered":"2024-09-21T01:49:41.352351+0000","last_clean":"2024-09-21T01:49:41.352351+0000","last_became_active":"2024-09-21T01:49:39.354261+0000","last_became_peered":"2024-09-21T01:49:39.354261+0000","last_unstale":"2024-09-21T01:49:41.352351+0000","last_undegraded":"2024-09-21T01:49:41.352351+0000","last_fullsized":"2024-09-21T01:49:41.352351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:43.205610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350925+0000","last_change":"2024-09-21T01:49:40.356386+0000","last_active":"2024-09-21T01:49:41.350925+0000","last_peered":"2024-09-21T01:49:41.350925+0000","last_clean":"2024-09-21T01:49:41.350925+0000","last_became_active":"2024-09-21T01:49:40.356070+0000","last_became_peered":"2024-09-21T01:49:40.356070+0000","last_unstale":"2024-09-21T01:49:41.350925+0000","last_undegraded":"2024-09-21T01:49:41.350925+0000","last_fullsized":"2024-09-21T01:49:41.350925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535066+0000","last_change":"2024-09-21T01:49:39.345519+0000","last_active":"2024-09-21T01:49:41.535066+0000","last_peered":"2024-09-21T01:49:41.535066+0000","last_clean":"2024-09-21T01:49:41.535066+0000","last_became_active":"2024-09-21T01:49:39.345204+0000","last_became_peered":"2024-09-21T01:49:39.345204+0000","last_unstale":"2024-09-21T01:49:41.535066+0000","last_undegraded":"2024-09-21T01:49:41.535066+0000","last_fullsized":"2024-09-21T01:49:41.535066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:43.979023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351716+0000","last_change":"2024-09-21T01:49:39.348849+0000","last_active":"2024-09-21T01:49:41.351716+0000","last_peered":"2024-09-21T01:49:41.351716+0000","last_clean":"2024-09-21T01:49:41.351716+0000","last_became_active":"2024-09-21T01:49:39.348541+0000","last_became_peered":"2024-09-21T01:49:39.348541+0000","last_unstale":"2024-09-21T01:49:41.351716+0000","last_undegraded":"2024-09-21T01:49:41.351716+0000","last_fullsized":"2024-09-21T01:49:41.351716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:45.215963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351473+0000","last_change":"2024-09-21T01:49:40.357207+0000","last_active":"2024-09-21T01:49:41.351473+0000","last_peered":"2024-09-21T01:49:41.351473+0000","last_clean":"2024-09-21T01:49:41.351473+0000","last_became_active":"2024-09-21T01:49:40.356888+0000","last_became_peered":"2024-09-21T01:49:40.356888+0000","last_unstale":"2024-09-21T01:49:41.351473+0000","last_undegraded":"2024-09-21T01:49:41.351473+0000","last_fullsized":"2024-09-21T01:49:41.351473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:47.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736549+0000","last_change":"2024-09-21T01:49:39.358208+0000","last_active":"2024-09-21T01:49:41.736549+0000","last_peered":"2024-09-21T01:49:41.736549+0000","last_clean":"2024-09-21T01:49:41.736549+0000","last_became_active":"2024-09-21T01:49:39.357751+0000","last_became_peered":"2024-09-21T01:49:39.357751+0000","last_unstale":"2024-09-21T01:49:41.736549+0000","last_undegraded":"2024-09-21T01:49:41.736549+0000","last_fullsized":"2024-09-21T01:49:41.736549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:17.291066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736125+0000","last_change":"2024-09-21T01:49:40.352449+0000","last_active":"2024-09-21T01:49:41.736125+0000","last_peered":"2024-09-21T01:49:41.736125+0000","last_clean":"2024-09-21T01:49:41.736125+0000","last_became_active":"2024-09-21T01:49:40.352149+0000","last_became_peered":"2024-09-21T01:49:40.352149+0000","last_unstale":"2024-09-21T01:49:41.736125+0000","last_undegraded":"2024-09-21T01:49:41.736125+0000","last_fullsized":"2024-09-21T01:49:41.736125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:11.903566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535350+0000","last_change":"2024-09-21T01:49:39.356457+0000","last_active":"2024-09-21T01:49:41.535350+0000","last_peered":"2024-09-21T01:49:41.535350+0000","last_clean":"2024-09-21T01:49:41.535350+0000","last_became_active":"2024-09-21T01:49:39.356087+0000","last_became_peered":"2024-09-21T01:49:39.356087+0000","last_unstale":"2024-09-21T01:49:41.535350+0000","last_undegraded":"2024-09-21T01:49:41.535350+0000","last_fullsized":"2024-09-21T01:49:41.535350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:02.371670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737704+0000","last_change":"2024-09-21T01:49:40.356593+0000","last_active":"2024-09-21T01:49:41.737704+0000","last_peered":"2024-09-21T01:49:41.737704+0000","last_clean":"2024-09-21T01:49:41.737704+0000","last_became_active":"2024-09-21T01:49:40.356244+0000","last_became_peered":"2024-09-21T01:49:40.356244+0000","last_unstale":"2024-09-21T01:49:41.737704+0000","last_undegraded":"2024-09-21T01:49:41.737704+0000","last_fullsized":"2024-09-21T01:49:41.737704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:34.045247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737251+0000","last_change":"2024-09-21T01:49:39.356069+0000","last_active":"2024-09-21T01:49:41.737251+0000","last_peered":"2024-09-21T01:49:41.737251+0000","last_clean":"2024-09-21T01:49:41.737251+0000","last_became_active":"2024-09-21T01:49:39.355711+0000","last_became_peered":"2024-09-21T01:49:39.355711+0000","last_unstale":"2024-09-21T01:49:41.737251+0000","last_undegraded":"2024-09-21T01:49:41.737251+0000","last_fullsized":"2024-09-21T01:49:41.737251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:26.423985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350888+0000","last_change":"2024-09-21T01:49:40.365005+0000","last_active":"2024-09-21T01:49:41.350888+0000","last_peered":"2024-09-21T01:49:41.350888+0000","last_clean":"2024-09-21T01:49:41.350888+0000","last_became_active":"2024-09-21T01:49:40.364593+0000","last_became_peered":"2024-09-21T01:49:40.364593+0000","last_unstale":"2024-09-21T01:49:41.350888+0000","last_undegraded":"2024-09-21T01:49:41.350888+0000","last_fullsized":"2024-09-21T01:49:41.350888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:24.814662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736394+0000","last_change":"2024-09-21T01:49:39.354177+0000","last_active":"2024-09-21T01:49:41.736394+0000","last_peered":"2024-09-21T01:49:41.736394+0000","last_clean":"2024-09-21T01:49:41.736394+0000","last_became_active":"2024-09-21T01:49:39.353830+0000","last_became_peered":"2024-09-21T01:49:39.353830+0000","last_unstale":"2024-09-21T01:49:41.736394+0000","last_undegraded":"2024-09-21T01:49:41.736394+0000","last_fullsized":"2024-09-21T01:49:41.736394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:15.388595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353615+0000","last_change":"2024-09-21T01:49:40.351596+0000","last_active":"2024-09-21T01:49:41.353615+0000","last_peered":"2024-09-21T01:49:41.353615+0000","last_clean":"2024-09-21T01:49:41.353615+0000","last_became_active":"2024-09-21T01:49:40.350101+0000","last_became_peered":"2024-09-21T01:49:40.350101+0000","last_unstale":"2024-09-21T01:49:41.353615+0000","last_undegraded":"2024-09-21T01:49:41.353615+0000","last_fullsized":"2024-09-21T01:49:41.353615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:48.287340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535256+0000","last_change":"2024-09-21T01:49:39.347072+0000","last_active":"2024-09-21T01:49:41.535256+0000","last_peered":"2024-09-21T01:49:41.535256+0000","last_clean":"2024-09-21T01:49:41.535256+0000","last_became_active":"2024-09-21T01:49:39.346726+0000","last_became_peered":"2024-09-21T01:49:39.346726+0000","last_unstale":"2024-09-21T01:49:41.535256+0000","last_undegraded":"2024-09-21T01:49:41.535256+0000","last_fullsized":"2024-09-21T01:49:41.535256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:47.281134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737098+0000","last_change":"2024-09-21T01:49:40.361933+0000","last_active":"2024-09-21T01:49:41.737098+0000","last_peered":"2024-09-21T01:49:41.737098+0000","last_clean":"2024-09-21T01:49:41.737098+0000","last_became_active":"2024-09-21T01:49:40.361599+0000","last_became_peered":"2024-09-21T01:49:40.361599+0000","last_unstale":"2024-09-21T01:49:41.737098+0000","last_undegraded":"2024-09-21T01:49:41.737098+0000","last_fullsized":"2024-09-21T01:49:41.737098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:14.949645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351000+0000","last_change":"2024-09-21T01:49:39.352696+0000","last_active":"2024-09-21T01:49:41.351000+0000","last_peered":"2024-09-21T01:49:41.351000+0000","last_clean":"2024-09-21T01:49:41.351000+0000","last_became_active":"2024-09-21T01:49:39.352336+0000","last_became_peered":"2024-09-21T01:49:39.352336+0000","last_unstale":"2024-09-21T01:49:41.351000+0000","last_undegraded":"2024-09-21T01:49:41.351000+0000","last_fullsized":"2024-09-21T01:49:41.351000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:43.205610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350554+0000","last_change":"2024-09-21T01:49:40.349301+0000","last_active":"2024-09-21T01:49:41.350554+0000","last_peered":"2024-09-21T01:49:41.350554+0000","last_clean":"2024-09-21T01:49:41.350554+0000","last_became_active":"2024-09-21T01:49:40.348932+0000","last_became_peered":"2024-09-21T01:49:40.348932+0000","last_unstale":"2024-09-21T01:49:41.350554+0000","last_undegraded":"2024-09-21T01:49:41.350554+0000","last_fullsized":"2024-09-21T01:49:41.350554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:26.393817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737256+0000","last_change":"2024-09-21T01:49:39.354615+0000","last_active":"2024-09-21T01:49:41.737256+0000","last_peered":"2024-09-21T01:49:41.737256+0000","last_clean":"2024-09-21T01:49:41.737256+0000","last_became_active":"2024-09-21T01:49:39.354155+0000","last_became_peered":"2024-09-21T01:49:39.354155+0000","last_unstale":"2024-09-21T01:49:41.737256+0000","last_undegraded":"2024-09-21T01:49:41.737256+0000","last_fullsized":"2024-09-21T01:49:41.737256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:17.741128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737707+0000","last_change":"2024-09-21T01:49:40.358953+0000","last_active":"2024-09-21T01:49:41.737707+0000","last_peered":"2024-09-21T01:49:41.737707+0000","last_clean":"2024-09-21T01:49:41.737707+0000","last_became_active":"2024-09-21T01:49:40.358659+0000","last_became_peered":"2024-09-21T01:49:40.358659+0000","last_unstale":"2024-09-21T01:49:41.737707+0000","last_undegraded":"2024-09-21T01:49:41.737707+0000","last_fullsized":"2024-09-21T01:49:41.737707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.223285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535008+0000","last_change":"2024-09-21T01:49:39.344739+0000","last_active":"2024-09-21T01:49:41.535008+0000","last_peered":"2024-09-21T01:49:41.535008+0000","last_clean":"2024-09-21T01:49:41.535008+0000","last_became_active":"2024-09-21T01:49:39.344397+0000","last_became_peered":"2024-09-21T01:49:39.344397+0000","last_unstale":"2024-09-21T01:49:41.535008+0000","last_undegraded":"2024-09-21T01:49:41.535008+0000","last_fullsized":"2024-09-21T01:49:41.535008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:27.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535220+0000","last_change":"2024-09-21T01:49:40.364133+0000","last_active":"2024-09-21T01:49:41.535220+0000","last_peered":"2024-09-21T01:49:41.535220+0000","last_clean":"2024-09-21T01:49:41.535220+0000","last_became_active":"2024-09-21T01:49:40.363324+0000","last_became_peered":"2024-09-21T01:49:40.363324+0000","last_unstale":"2024-09-21T01:49:41.535220+0000","last_undegraded":"2024-09-21T01:49:41.535220+0000","last_fullsized":"2024-09-21T01:49:41.535220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:47.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735791+0000","last_change":"2024-09-21T01:49:39.352951+0000","last_active":"2024-09-21T01:49:41.735791+0000","last_peered":"2024-09-21T01:49:41.735791+0000","last_clean":"2024-09-21T01:49:41.735791+0000","last_became_active":"2024-09-21T01:49:39.352592+0000","last_became_peered":"2024-09-21T01:49:39.352592+0000","last_unstale":"2024-09-21T01:49:41.735791+0000","last_undegraded":"2024-09-21T01:49:41.735791+0000","last_fullsized":"2024-09-21T01:49:41.735791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:21.017265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737020+0000","last_change":"2024-09-21T01:49:40.356971+0000","last_active":"2024-09-21T01:49:41.737020+0000","last_peered":"2024-09-21T01:49:41.737020+0000","last_clean":"2024-09-21T01:49:41.737020+0000","last_became_active":"2024-09-21T01:49:40.356575+0000","last_became_peered":"2024-09-21T01:49:40.356575+0000","last_unstale":"2024-09-21T01:49:41.737020+0000","last_undegraded":"2024-09-21T01:49:41.737020+0000","last_fullsized":"2024-09-21T01:49:41.737020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:00.866709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353420+0000","last_change":"2024-09-21T01:49:39.350322+0000","last_active":"2024-09-21T01:49:41.353420+0000","last_peered":"2024-09-21T01:49:41.353420+0000","last_clean":"2024-09-21T01:49:41.353420+0000","last_became_active":"2024-09-21T01:49:39.349770+0000","last_became_peered":"2024-09-21T01:49:39.349770+0000","last_unstale":"2024-09-21T01:49:41.353420+0000","last_undegraded":"2024-09-21T01:49:41.353420+0000","last_fullsized":"2024-09-21T01:49:41.353420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:26.105437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737557+0000","last_change":"2024-09-21T01:49:40.364278+0000","last_active":"2024-09-21T01:49:41.737557+0000","last_peered":"2024-09-21T01:49:41.737557+0000","last_clean":"2024-09-21T01:49:41.737557+0000","last_became_active":"2024-09-21T01:49:40.363949+0000","last_became_peered":"2024-09-21T01:49:40.363949+0000","last_unstale":"2024-09-21T01:49:41.737557+0000","last_undegraded":"2024-09-21T01:49:41.737557+0000","last_fullsized":"2024-09-21T01:49:41.737557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:45.719101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736424+0000","last_change":"2024-09-21T01:49:39.346299+0000","last_active":"2024-09-21T01:49:41.736424+0000","last_peered":"2024-09-21T01:49:41.736424+0000","last_clean":"2024-09-21T01:49:41.736424+0000","last_became_active":"2024-09-21T01:49:39.345944+0000","last_became_peered":"2024-09-21T01:49:39.345944+0000","last_unstale":"2024-09-21T01:49:41.736424+0000","last_undegraded":"2024-09-21T01:49:41.736424+0000","last_fullsized":"2024-09-21T01:49:41.736424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:19.582036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.738129+0000","last_change":"2024-09-21T01:49:40.364893+0000","last_active":"2024-09-21T01:49:41.738129+0000","last_peered":"2024-09-21T01:49:41.738129+0000","last_clean":"2024-09-21T01:49:41.738129+0000","last_became_active":"2024-09-21T01:49:40.364145+0000","last_became_peered":"2024-09-21T01:49:40.364145+0000","last_unstale":"2024-09-21T01:49:41.738129+0000","last_undegraded":"2024-09-21T01:49:41.738129+0000","last_fullsized":"2024-09-21T01:49:41.738129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:03.444824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736525+0000","last_change":"2024-09-21T01:49:39.341903+0000","last_active":"2024-09-21T01:49:41.736525+0000","last_peered":"2024-09-21T01:49:41.736525+0000","last_clean":"2024-09-21T01:49:41.736525+0000","last_became_active":"2024-09-21T01:49:39.339820+0000","last_became_peered":"2024-09-21T01:49:39.339820+0000","last_unstale":"2024-09-21T01:49:41.736525+0000","last_undegraded":"2024-09-21T01:49:41.736525+0000","last_fullsized":"2024-09-21T01:49:41.736525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:09.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737057+0000","last_change":"2024-09-21T01:49:40.371573+0000","last_active":"2024-09-21T01:49:41.737057+0000","last_peered":"2024-09-21T01:49:41.737057+0000","last_clean":"2024-09-21T01:49:41.737057+0000","last_became_active":"2024-09-21T01:49:40.371260+0000","last_became_peered":"2024-09-21T01:49:40.371260+0000","last_unstale":"2024-09-21T01:49:41.737057+0000","last_undegraded":"2024-09-21T01:49:41.737057+0000","last_fullsized":"2024-09-21T01:49:41.737057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:52.256418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735984+0000","last_change":"2024-09-21T01:49:39.357807+0000","last_active":"2024-09-21T01:49:41.735984+0000","last_peered":"2024-09-21T01:49:41.735984+0000","last_clean":"2024-09-21T01:49:41.735984+0000","last_became_active":"2024-09-21T01:49:39.357452+0000","last_became_peered":"2024-09-21T01:49:39.357452+0000","last_unstale":"2024-09-21T01:49:41.735984+0000","last_undegraded":"2024-09-21T01:49:41.735984+0000","last_fullsized":"2024-09-21T01:49:41.735984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:13.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737329+0000","last_change":"2024-09-21T01:49:40.361593+0000","last_active":"2024-09-21T01:49:41.737329+0000","last_peered":"2024-09-21T01:49:41.737329+0000","last_clean":"2024-09-21T01:49:41.737329+0000","last_became_active":"2024-09-21T01:49:40.360542+0000","last_became_peered":"2024-09-21T01:49:40.360542+0000","last_unstale":"2024-09-21T01:49:41.737329+0000","last_undegraded":"2024-09-21T01:49:41.737329+0000","last_fullsized":"2024-09-21T01:49:41.737329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:42.329087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736838+0000","last_change":"2024-09-21T01:49:29.995848+0000","last_active":"2024-09-21T01:49:41.736838+0000","last_peered":"2024-09-21T01:49:41.736838+0000","last_clean":"2024-09-21T01:49:41.736838+0000","last_became_active":"2024-09-21T01:49:29.994790+0000","last_became_peered":"2024-09-21T01:49:29.994790+0000","last_unstale":"2024-09-21T01:49:41.736838+0000","last_undegraded":"2024-09-21T01:49:41.736838+0000","last_fullsized":"2024-09-21T01:49:41.736838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_clean_scrub_stamp":"2024-09-21T01:49:28.252238+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:30.318506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736286+0000","last_change":"2024-09-21T01:49:39.356186+0000","last_active":"2024-09-21T01:49:41.736286+0000","last_peered":"2024-09-21T01:49:41.736286+0000","last_clean":"2024-09-21T01:49:41.736286+0000","last_became_active":"2024-09-21T01:49:39.354842+0000","last_became_peered":"2024-09-21T01:49:39.354842+0000","last_unstale":"2024-09-21T01:49:41.736286+0000","last_undegraded":"2024-09-21T01:49:41.736286+0000","last_fullsized":"2024-09-21T01:49:41.736286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352187+0000","last_change":"2024-09-21T01:49:40.363797+0000","last_active":"2024-09-21T01:49:41.352187+0000","last_peered":"2024-09-21T01:49:41.352187+0000","last_clean":"2024-09-21T01:49:41.352187+0000","last_became_active":"2024-09-21T01:49:40.363490+0000","last_became_peered":"2024-09-21T01:49:40.363490+0000","last_unstale":"2024-09-21T01:49:41.352187+0000","last_undegraded":"2024-09-21T01:49:41.352187+0000","last_fullsized":"2024-09-21T01:49:41.352187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:36.062812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736708+0000","last_change":"2024-09-21T01:49:39.356359+0000","last_active":"2024-09-21T01:49:41.736708+0000","last_peered":"2024-09-21T01:49:41.736708+0000","last_clean":"2024-09-21T01:49:41.736708+0000","last_became_active":"2024-09-21T01:49:39.356029+0000","last_became_peered":"2024-09-21T01:49:39.356029+0000","last_unstale":"2024-09-21T01:49:41.736708+0000","last_undegraded":"2024-09-21T01:49:41.736708+0000","last_fullsized":"2024-09-21T01:49:41.736708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:47.281134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350257+0000","last_change":"2024-09-21T01:49:40.346325+0000","last_active":"2024-09-21T01:49:41.350257+0000","last_peered":"2024-09-21T01:49:41.350257+0000","last_clean":"2024-09-21T01:49:41.350257+0000","last_became_active":"2024-09-21T01:49:40.345976+0000","last_became_peered":"2024-09-21T01:49:40.345976+0000","last_unstale":"2024-09-21T01:49:41.350257+0000","last_undegraded":"2024-09-21T01:49:41.350257+0000","last_fullsized":"2024-09-21T01:49:41.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:16.293654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736138+0000","last_change":"2024-09-21T01:49:39.346504+0000","last_active":"2024-09-21T01:49:41.736138+0000","last_peered":"2024-09-21T01:49:41.736138+0000","last_clean":"2024-09-21T01:49:41.736138+0000","last_became_active":"2024-09-21T01:49:39.345964+0000","last_became_peered":"2024-09-21T01:49:39.345964+0000","last_unstale":"2024-09-21T01:49:41.736138+0000","last_undegraded":"2024-09-21T01:49:41.736138+0000","last_fullsized":"2024-09-21T01:49:41.736138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736581+0000","last_change":"2024-09-21T01:49:40.355895+0000","last_active":"2024-09-21T01:49:41.736581+0000","last_peered":"2024-09-21T01:49:41.736581+0000","last_clean":"2024-09-21T01:49:41.736581+0000","last_became_active":"2024-09-21T01:49:40.355565+0000","last_became_peered":"2024-09-21T01:49:40.355565+0000","last_unstale":"2024-09-21T01:49:41.736581+0000","last_undegraded":"2024-09-21T01:49:41.736581+0000","last_fullsized":"2024-09-21T01:49:41.736581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:32.806782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737699+0000","last_change":"2024-09-21T01:49:39.354243+0000","last_active":"2024-09-21T01:49:41.737699+0000","last_peered":"2024-09-21T01:49:41.737699+0000","last_clean":"2024-09-21T01:49:41.737699+0000","last_became_active":"2024-09-21T01:49:39.353072+0000","last_became_peered":"2024-09-21T01:49:39.353072+0000","last_unstale":"2024-09-21T01:49:41.737699+0000","last_undegraded":"2024-09-21T01:49:41.737699+0000","last_fullsized":"2024-09-21T01:49:41.737699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:17.764196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353693+0000","last_change":"2024-09-21T01:49:40.352821+0000","last_active":"2024-09-21T01:49:41.353693+0000","last_peered":"2024-09-21T01:49:41.353693+0000","last_clean":"2024-09-21T01:49:41.353693+0000","last_became_active":"2024-09-21T01:49:40.351889+0000","last_became_peered":"2024-09-21T01:49:40.351889+0000","last_unstale":"2024-09-21T01:49:41.353693+0000","last_undegraded":"2024-09-21T01:49:41.353693+0000","last_fullsized":"2024-09-21T01:49:41.353693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:05.023859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736502+0000","last_change":"2024-09-21T01:49:39.351127+0000","last_active":"2024-09-21T01:49:41.736502+0000","last_peered":"2024-09-21T01:49:41.736502+0000","last_clean":"2024-09-21T01:49:41.736502+0000","last_became_active":"2024-09-21T01:49:39.350783+0000","last_became_peered":"2024-09-21T01:49:39.350783+0000","last_unstale":"2024-09-21T01:49:41.736502+0000","last_undegraded":"2024-09-21T01:49:41.736502+0000","last_fullsized":"2024-09-21T01:49:41.736502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:42.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737434+0000","last_change":"2024-09-21T01:49:40.368882+0000","last_active":"2024-09-21T01:49:41.737434+0000","last_peered":"2024-09-21T01:49:41.737434+0000","last_clean":"2024-09-21T01:49:41.737434+0000","last_became_active":"2024-09-21T01:49:40.367820+0000","last_became_peered":"2024-09-21T01:49:40.367820+0000","last_unstale":"2024-09-21T01:49:41.737434+0000","last_undegraded":"2024-09-21T01:49:41.737434+0000","last_fullsized":"2024-09-21T01:49:41.737434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:45.001295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737894+0000","last_change":"2024-09-21T01:49:39.356508+0000","last_active":"2024-09-21T01:49:41.737894+0000","last_peered":"2024-09-21T01:49:41.737894+0000","last_clean":"2024-09-21T01:49:41.737894+0000","last_became_active":"2024-09-21T01:49:39.356169+0000","last_became_peered":"2024-09-21T01:49:39.356169+0000","last_unstale":"2024-09-21T01:49:41.737894+0000","last_undegraded":"2024-09-21T01:49:41.737894+0000","last_fullsized":"2024-09-21T01:49:41.737894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:52.672165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736513+0000","last_change":"2024-09-21T01:49:40.351790+0000","last_active":"2024-09-21T01:49:41.736513+0000","last_peered":"2024-09-21T01:49:41.736513+0000","last_clean":"2024-09-21T01:49:41.736513+0000","last_became_active":"2024-09-21T01:49:40.351392+0000","last_became_peered":"2024-09-21T01:49:40.351392+0000","last_unstale":"2024-09-21T01:49:41.736513+0000","last_undegraded":"2024-09-21T01:49:41.736513+0000","last_fullsized":"2024-09-21T01:49:41.736513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:45.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:42.340972+0000","last_change":"2024-09-21T01:49:39.353294+0000","last_active":"2024-09-21T01:49:42.340972+0000","last_peered":"2024-09-21T01:49:42.340972+0000","last_clean":"2024-09-21T01:49:42.340972+0000","last_became_active":"2024-09-21T01:49:39.352984+0000","last_became_peered":"2024-09-21T01:49:39.352984+0000","last_unstale":"2024-09-21T01:49:42.340972+0000","last_undegraded":"2024-09-21T01:49:42.340972+0000","last_fullsized":"2024-09-21T01:49:42.340972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:31.319877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351908+0000","last_change":"2024-09-21T01:49:40.351451+0000","last_active":"2024-09-21T01:49:41.351908+0000","last_peered":"2024-09-21T01:49:41.351908+0000","last_clean":"2024-09-21T01:49:41.351908+0000","last_became_active":"2024-09-21T01:49:40.351100+0000","last_became_peered":"2024-09-21T01:49:40.351100+0000","last_unstale":"2024-09-21T01:49:41.351908+0000","last_undegraded":"2024-09-21T01:49:41.351908+0000","last_fullsized":"2024-09-21T01:49:41.351908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:15.787679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535436+0000","last_change":"2024-09-21T01:49:39.353205+0000","last_active":"2024-09-21T01:49:41.535436+0000","last_peered":"2024-09-21T01:49:41.535436+0000","last_clean":"2024-09-21T01:49:41.535436+0000","last_became_active":"2024-09-21T01:49:39.352858+0000","last_became_peered":"2024-09-21T01:49:39.352858+0000","last_unstale":"2024-09-21T01:49:41.535436+0000","last_undegraded":"2024-09-21T01:49:41.535436+0000","last_fullsized":"2024-09-21T01:49:41.535436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:35.086866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350768+0000","last_change":"2024-09-21T01:49:40.354056+0000","last_active":"2024-09-21T01:49:41.350768+0000","last_peered":"2024-09-21T01:49:41.350768+0000","last_clean":"2024-09-21T01:49:41.350768+0000","last_became_active":"2024-09-21T01:49:40.353701+0000","last_became_peered":"2024-09-21T01:49:40.353701+0000","last_unstale":"2024-09-21T01:49:41.350768+0000","last_undegraded":"2024-09-21T01:49:41.350768+0000","last_fullsized":"2024-09-21T01:49:41.350768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:36.817174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736561+0000","last_change":"2024-09-21T01:49:39.355387+0000","last_active":"2024-09-21T01:49:41.736561+0000","last_peered":"2024-09-21T01:49:41.736561+0000","last_clean":"2024-09-21T01:49:41.736561+0000","last_became_active":"2024-09-21T01:49:39.355048+0000","last_became_peered":"2024-09-21T01:49:39.355048+0000","last_unstale":"2024-09-21T01:49:41.736561+0000","last_undegraded":"2024-09-21T01:49:41.736561+0000","last_fullsized":"2024-09-21T01:49:41.736561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:27.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353474+0000","last_change":"2024-09-21T01:49:40.351959+0000","last_active":"2024-09-21T01:49:41.353474+0000","last_peered":"2024-09-21T01:49:41.353474+0000","last_clean":"2024-09-21T01:49:41.353474+0000","last_became_active":"2024-09-21T01:49:40.351308+0000","last_became_peered":"2024-09-21T01:49:40.351308+0000","last_unstale":"2024-09-21T01:49:41.353474+0000","last_undegraded":"2024-09-21T01:49:41.353474+0000","last_fullsized":"2024-09-21T01:49:41.353474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:28.397512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736277+0000","last_change":"2024-09-21T01:49:39.350179+0000","last_active":"2024-09-21T01:49:41.736277+0000","last_peered":"2024-09-21T01:49:41.736277+0000","last_clean":"2024-09-21T01:49:41.736277+0000","last_became_active":"2024-09-21T01:49:39.347968+0000","last_became_peered":"2024-09-21T01:49:39.347968+0000","last_unstale":"2024-09-21T01:49:41.736277+0000","last_undegraded":"2024-09-21T01:49:41.736277+0000","last_fullsized":"2024-09-21T01:49:41.736277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352083+0000","last_change":"2024-09-21T01:49:40.354991+0000","last_active":"2024-09-21T01:49:41.352083+0000","last_peered":"2024-09-21T01:49:41.352083+0000","last_clean":"2024-09-21T01:49:41.352083+0000","last_became_active":"2024-09-21T01:49:40.352773+0000","last_became_peered":"2024-09-21T01:49:40.352773+0000","last_unstale":"2024-09-21T01:49:41.352083+0000","last_undegraded":"2024-09-21T01:49:41.352083+0000","last_fullsized":"2024-09-21T01:49:41.352083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:26.545436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736233+0000","last_change":"2024-09-21T01:49:39.349158+0000","last_active":"2024-09-21T01:49:41.736233+0000","last_peered":"2024-09-21T01:49:41.736233+0000","last_clean":"2024-09-21T01:49:41.736233+0000","last_became_active":"2024-09-21T01:49:39.347821+0000","last_became_peered":"2024-09-21T01:49:39.347821+0000","last_unstale":"2024-09-21T01:49:41.736233+0000","last_undegraded":"2024-09-21T01:49:41.736233+0000","last_fullsized":"2024-09-21T01:49:41.736233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:02.187963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352318+0000","last_change":"2024-09-21T01:49:40.355562+0000","last_active":"2024-09-21T01:49:41.352318+0000","last_peered":"2024-09-21T01:49:41.352318+0000","last_clean":"2024-09-21T01:49:41.352318+0000","last_became_active":"2024-09-21T01:49:40.354546+0000","last_became_peered":"2024-09-21T01:49:40.354546+0000","last_unstale":"2024-09-21T01:49:41.352318+0000","last_undegraded":"2024-09-21T01:49:41.352318+0000","last_fullsized":"2024-09-21T01:49:41.352318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:52.645109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737751+0000","last_change":"2024-09-21T01:49:39.358033+0000","last_active":"2024-09-21T01:49:41.737751+0000","last_peered":"2024-09-21T01:49:41.737751+0000","last_clean":"2024-09-21T01:49:41.737751+0000","last_became_active":"2024-09-21T01:49:39.357680+0000","last_became_peered":"2024-09-21T01:49:39.357680+0000","last_unstale":"2024-09-21T01:49:41.737751+0000","last_undegraded":"2024-09-21T01:49:41.737751+0000","last_fullsized":"2024-09-21T01:49:41.737751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:09:19.831260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535186+0000","last_change":"2024-09-21T01:49:40.365613+0000","last_active":"2024-09-21T01:49:41.535186+0000","last_peered":"2024-09-21T01:49:41.535186+0000","last_clean":"2024-09-21T01:49:41.535186+0000","last_became_active":"2024-09-21T01:49:40.365297+0000","last_became_peered":"2024-09-21T01:49:40.365297+0000","last_unstale":"2024-09-21T01:49:41.535186+0000","last_undegraded":"2024-09-21T01:49:41.535186+0000","last_fullsized":"2024-09-21T01:49:41.535186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.999168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736952+0000","last_change":"2024-09-21T01:49:40.367268+0000","last_active":"2024-09-21T01:49:41.736952+0000","last_peered":"2024-09-21T01:49:41.736952+0000","last_clean":"2024-09-21T01:49:41.736952+0000","last_became_active":"2024-09-21T01:49:40.366946+0000","last_became_peered":"2024-09-21T01:49:40.366946+0000","last_unstale":"2024-09-21T01:49:41.736952+0000","last_undegraded":"2024-09-21T01:49:41.736952+0000","last_fullsized":"2024-09-21T01:49:41.736952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:29.301249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736693+0000","last_change":"2024-09-21T01:49:39.359266+0000","last_active":"2024-09-21T01:49:41.736693+0000","last_peered":"2024-09-21T01:49:41.736693+0000","last_clean":"2024-09-21T01:49:41.736693+0000","last_became_active":"2024-09-21T01:49:39.358350+0000","last_became_peered":"2024-09-21T01:49:39.358350+0000","last_unstale":"2024-09-21T01:49:41.736693+0000","last_undegraded":"2024-09-21T01:49:41.736693+0000","last_fullsized":"2024-09-21T01:49:41.736693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:43.979023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737278+0000","last_change":"2024-09-21T01:49:40.367875+0000","last_active":"2024-09-21T01:49:41.737278+0000","last_peered":"2024-09-21T01:49:41.737278+0000","last_clean":"2024-09-21T01:49:41.737278+0000","last_became_active":"2024-09-21T01:49:40.367529+0000","last_became_peered":"2024-09-21T01:49:40.367529+0000","last_unstale":"2024-09-21T01:49:41.737278+0000","last_undegraded":"2024-09-21T01:49:41.737278+0000","last_fullsized":"2024-09-21T01:49:41.737278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:17.573511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737423+0000","last_change":"2024-09-21T01:49:39.359628+0000","last_active":"2024-09-21T01:49:41.737423+0000","last_peered":"2024-09-21T01:49:41.737423+0000","last_clean":"2024-09-21T01:49:41.737423+0000","last_became_active":"2024-09-21T01:49:39.359209+0000","last_became_peered":"2024-09-21T01:49:39.359209+0000","last_unstale":"2024-09-21T01:49:41.737423+0000","last_undegraded":"2024-09-21T01:49:41.737423+0000","last_fullsized":"2024-09-21T01:49:41.737423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:04.017652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350648+0000","last_change":"2024-09-21T01:49:40.364917+0000","last_active":"2024-09-21T01:49:41.350648+0000","last_peered":"2024-09-21T01:49:41.350648+0000","last_clean":"2024-09-21T01:49:41.350648+0000","last_became_active":"2024-09-21T01:49:40.364166+0000","last_became_peered":"2024-09-21T01:49:40.364166+0000","last_unstale":"2024-09-21T01:49:41.350648+0000","last_undegraded":"2024-09-21T01:49:41.350648+0000","last_fullsized":"2024-09-21T01:49:41.350648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:08.726343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351636+0000","last_change":"2024-09-21T01:49:39.356150+0000","last_active":"2024-09-21T01:49:41.351636+0000","last_peered":"2024-09-21T01:49:41.351636+0000","last_clean":"2024-09-21T01:49:41.351636+0000","last_became_active":"2024-09-21T01:49:39.355548+0000","last_became_peered":"2024-09-21T01:49:39.355548+0000","last_unstale":"2024-09-21T01:49:41.351636+0000","last_undegraded":"2024-09-21T01:49:41.351636+0000","last_fullsized":"2024-09-21T01:49:41.351636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:02.371670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351655+0000","last_change":"2024-09-21T01:49:40.357471+0000","last_active":"2024-09-21T01:49:41.351655+0000","last_peered":"2024-09-21T01:49:41.351655+0000","last_clean":"2024-09-21T01:49:41.351655+0000","last_became_active":"2024-09-21T01:49:40.357158+0000","last_became_peered":"2024-09-21T01:49:40.357158+0000","last_unstale":"2024-09-21T01:49:41.351655+0000","last_undegraded":"2024-09-21T01:49:41.351655+0000","last_fullsized":"2024-09-21T01:49:41.351655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:22:28.048336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350824+0000","last_change":"2024-09-21T01:49:39.354483+0000","last_active":"2024-09-21T01:49:41.350824+0000","last_peered":"2024-09-21T01:49:41.350824+0000","last_clean":"2024-09-21T01:49:41.350824+0000","last_became_active":"2024-09-21T01:49:39.354167+0000","last_became_peered":"2024-09-21T01:49:39.354167+0000","last_unstale":"2024-09-21T01:49:41.350824+0000","last_undegraded":"2024-09-21T01:49:41.350824+0000","last_fullsized":"2024-09-21T01:49:41.350824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:08:48.875745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":662973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:49:49.289 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T01:49:49.289 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T01:49:49.289 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T01:49:49.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.440+0000 7f7bdc241640 1 -- 172.21.15.40:0/3195242595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40b3a60 msgr2=0x7f7bd40cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.440+0000 7f7bdc241640 1 --2- 172.21.15.40:0/3195242595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40b3a60 0x7f7bd40cfb70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7bd408d800 tx=0x7f7bd002a5f0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.440+0000 7f7bdc241640 1 -- 172.21.15.40:0/3195242595 shutdown_connections 2024-09-21T01:49:49.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.440+0000 7f7bdc241640 1 --2- 172.21.15.40:0/3195242595 >> v2:172.21.15.139:3300/0 conn(0x7f7bd40d0e10 0x7f7bd40d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.440+0000 7f7bdc241640 1 --2- 172.21.15.40:0/3195242595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40b3a60 0x7f7bd40cfb70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.440+0000 7f7bdc241640 1 -- 172.21.15.40:0/3195242595 >> 172.21.15.40:0/3195242595 conn(0x7f7bd408bfc0 msgr2=0x7f7bd409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:49.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.441+0000 7f7bdc241640 1 -- 172.21.15.40:0/3195242595 shutdown_connections 2024-09-21T01:49:49.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.441+0000 7f7bdc241640 1 -- 172.21.15.40:0/3195242595 wait complete. 2024-09-21T01:49:49.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.442+0000 7f7bdc241640 1 Processor -- start 2024-09-21T01:49:49.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.442+0000 7f7bdc241640 1 -- start start 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bdc241640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7bd406e3c0 0x7f7bd41f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bdc241640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bd40b3a60 0x7f7bd415fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bdc241640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40d0e10 0x7f7bd415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bdc241640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd40d2c10 con 0x7f7bd40d0e10 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bdc241640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd40d2a90 con 0x7f7bd40b3a60 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bdc241640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd40d2d90 con 0x7f7bd406e3c0 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bda7de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40d0e10 0x7f7bd415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bda7de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40d0e10 0x7f7bd415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50906/0 (socket says 172.21.15.40:50906) 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bda7de640 1 -- 172.21.15.40:0/947956170 learned_addr learned my addr 172.21.15.40:0/947956170 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bd97dc640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bd40b3a60 0x7f7bd415fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bd9fdd640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7bd406e3c0 0x7f7bd41f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bda7de640 1 -- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7bd406e3c0 msgr2=0x7f7bd41f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bda7de640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7bd406e3c0 0x7f7bd41f6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bda7de640 1 -- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bd40b3a60 msgr2=0x7f7bd415fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bda7de640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bd40b3a60 0x7f7bd415fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bda7de640 1 -- 172.21.15.40:0/947956170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd409ebe0 con 0x7f7bd40d0e10 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bd97dc640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bd40b3a60 0x7f7bd415fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.444+0000 7f7bda7de640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40d0e10 0x7f7bd415c660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00d9a0 tx=0x7f7bcc00de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.445+0000 7f7bca7fc640 1 -- 172.21.15.40:0/947956170 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc017070 con 0x7f7bd40d0e10 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.445+0000 7f7bca7fc640 1 -- 172.21.15.40:0/947956170 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bcc00be00 con 0x7f7bd40d0e10 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.445+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd409eec0 con 0x7f7bd40d0e10 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.445+0000 7f7bca7fc640 1 -- 172.21.15.40:0/947956170 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc003bd0 con 0x7f7bd40d0e10 2024-09-21T01:49:49.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.445+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd415f800 con 0x7f7bd40d0e10 2024-09-21T01:49:49.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.446+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd409e950 con 0x7f7bd40d0e10 2024-09-21T01:49:49.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.446+0000 7f7bca7fc640 1 -- 172.21.15.40:0/947956170 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7bcc010460 con 0x7f7bd40d0e10 2024-09-21T01:49:49.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.447+0000 7f7bca7fc640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7bb8078b90 0x7f7bb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.447+0000 7f7bca7fc640 1 -- 172.21.15.40:0/947956170 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7bcc09b100 con 0x7f7bd40d0e10 2024-09-21T01:49:49.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.447+0000 7f7bd9fdd640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7bb8078b90 0x7f7bb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.448+0000 7f7bd9fdd640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7bb8078b90 0x7f7bb807b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0033000 tx=0x7f7bd0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:49.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.452+0000 7f7bca7fc640 1 -- 172.21.15.40:0/947956170 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7bcc0635d0 con 0x7f7bd40d0e10 2024-09-21T01:49:49.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.643+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f7bd40d3240 con 0x7f7bd40d0e10 2024-09-21T01:49:49.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.644+0000 7f7bca7fc640 1 -- 172.21.15.40:0/947956170 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f7bcc062ed0 con 0x7f7bd40d0e10 2024-09-21T01:49:49.646 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7bb8078b90 msgr2=0x7f7bb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7bb8078b90 0x7f7bb807b0a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0033000 tx=0x7f7bd0004730 comp rx=0 tx=0).stop 2024-09-21T01:49:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40d0e10 msgr2=0x7f7bd415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40d0e10 0x7f7bd415c660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc00d9a0 tx=0x7f7bcc00de60 comp rx=0 tx=0).stop 2024-09-21T01:49:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 shutdown_connections 2024-09-21T01:49:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7bb8078b90 0x7f7bb807b0a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd40d0e10 0x7f7bd415c660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bd40b3a60 0x7f7bd415fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 --2- 172.21.15.40:0/947956170 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f7bd406e3c0 0x7f7bd41f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 >> 172.21.15.40:0/947956170 conn(0x7f7bd408bfc0 msgr2=0x7f7bd406ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 shutdown_connections 2024-09-21T01:49:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.646+0000 7f7bdc241640 1 -- 172.21.15.40:0/947956170 wait complete. 2024-09-21T01:49:49.659 INFO:teuthology.orchestra.run.smithi040.stdout:[{"version":31,"timestamp":"2024-09-21T01:49:28.120159+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"4930.312247"}]}] 2024-09-21T01:49:49.659 INFO:tasks.ceph_manager:config epoch is 31 2024-09-21T01:49:49.659 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T01:49:49.659 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T01:49:49.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T01:49:49.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.773+0000 7fa05ffcc640 1 -- 172.21.15.40:0/3710900974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580cf270 msgr2=0x7fa058072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.773+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/3710900974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580cf270 0x7fa058072850 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0580747a0 tx=0x7fa05002a980 comp rx=0 tx=0).stop 2024-09-21T01:49:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.773+0000 7fa05ffcc640 1 -- 172.21.15.40:0/3710900974 shutdown_connections 2024-09-21T01:49:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.773+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/3710900974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580cf270 0x7fa058072850 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.773+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/3710900974 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0580b7fe0 0x7fa0580ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.773+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/3710900974 >> v2:172.21.15.139:3300/0 conn(0x7fa0580cd360 0x7fa05815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.773+0000 7fa05ffcc640 1 -- 172.21.15.40:0/3710900974 >> 172.21.15.40:0/3710900974 conn(0x7fa0580710b0 msgr2=0x7fa0580714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.773+0000 7fa05ffcc640 1 -- 172.21.15.40:0/3710900974 shutdown_connections 2024-09-21T01:49:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.773+0000 7fa05ffcc640 1 -- 172.21.15.40:0/3710900974 wait complete. 2024-09-21T01:49:49.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.775+0000 7fa05ffcc640 1 Processor -- start 2024-09-21T01:49:49.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.775+0000 7fa05ffcc640 1 -- start start 2024-09-21T01:49:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05ffcc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580b7fe0 0x7fa05814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05ffcc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0580cd360 0x7fa0580b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05ffcc640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0580cf270 0x7fa0580b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05ffcc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa058073120 con 0x7fa0580b7fe0 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05ffcc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa058072fa0 con 0x7fa0580cd360 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05ffcc640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fa0580732a0 con 0x7fa0580cf270 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05dd68640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580b7fe0 0x7fa05814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05dd68640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580b7fe0 0x7fa05814e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50910/0 (socket says 172.21.15.40:50910) 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05dd68640 1 -- 172.21.15.40:0/2203036389 learned_addr learned my addr 172.21.15.40:0/2203036389 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05d567640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0580cd360 0x7fa0580b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05e569640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0580cf270 0x7fa0580b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05dd68640 1 -- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0580cf270 msgr2=0x7fa0580b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05dd68640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0580cf270 0x7fa0580b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05dd68640 1 -- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0580cd360 msgr2=0x7fa0580b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05dd68640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0580cd360 0x7fa0580b6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05dd68640 1 -- 172.21.15.40:0/2203036389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0581f9780 con 0x7fa0580b7fe0 2024-09-21T01:49:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05d567640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0580cd360 0x7fa0580b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05dd68640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580b7fe0 0x7fa05814e5d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa05400e790 tx=0x7fa05400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa04e7fc640 1 -- 172.21.15.40:0/2203036389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05400eea0 con 0x7fa0580b7fe0 2024-09-21T01:49:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa04e7fc640 1 -- 172.21.15.40:0/2203036389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa05400cdb0 con 0x7fa0580b7fe0 2024-09-21T01:49:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa04e7fc640 1 -- 172.21.15.40:0/2203036389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054010690 con 0x7fa0580b7fe0 2024-09-21T01:49:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.777+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0581f9a60 con 0x7fa0580b7fe0 2024-09-21T01:49:49.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.778+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05815e250 con 0x7fa0580b7fe0 2024-09-21T01:49:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.778+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05806a5e0 con 0x7fa0580b7fe0 2024-09-21T01:49:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.779+0000 7fa04e7fc640 1 -- 172.21.15.40:0/2203036389 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa054010830 con 0x7fa0580b7fe0 2024-09-21T01:49:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.780+0000 7fa04e7fc640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa03c078b90 0x7fa03c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.780+0000 7fa04e7fc640 1 -- 172.21.15.40:0/2203036389 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa05409b670 con 0x7fa0580b7fe0 2024-09-21T01:49:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.780+0000 7fa05d567640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa03c078b90 0x7fa03c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:49.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.780+0000 7fa05d567640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa03c078b90 0x7fa03c07b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa048005fd0 tx=0x7fa048005d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:49.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:49.784+0000 7fa04e7fc640 1 -- 172.21.15.40:0/2203036389 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa05806a5e0 con 0x7fa0580b7fe0 2024-09-21T01:49:50.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.023+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa05815c6a0 con 0x7fa0580b7fe0 2024-09-21T01:49:50.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.026+0000 7fa04e7fc640 1 -- 172.21.15.40:0/2203036389 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194717 (secure 0 0 0) 0x7fa054063b40 con 0x7fa0580b7fe0 2024-09-21T01:49:50.030 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:50.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa03c078b90 msgr2=0x7fa03c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa03c078b90 0x7fa03c07b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa048005fd0 tx=0x7fa048005d40 comp rx=0 tx=0).stop 2024-09-21T01:49:50.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580b7fe0 msgr2=0x7fa05814e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580b7fe0 0x7fa05814e5d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa05400e790 tx=0x7fa05400ec50 comp rx=0 tx=0).stop 2024-09-21T01:49:50.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 shutdown_connections 2024-09-21T01:49:50.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa03c078b90 0x7fa03c07b0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa0580cf270 0x7fa0580b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0580cd360 0x7fa0580b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 --2- 172.21.15.40:0/2203036389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0580b7fe0 0x7fa05814e5d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 >> 172.21.15.40:0/2203036389 conn(0x7fa0580710b0 msgr2=0x7fa0580d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 shutdown_connections 2024-09-21T01:49:50.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.029+0000 7fa05ffcc640 1 -- 172.21.15.40:0/2203036389 wait complete. 2024-09-21T01:49:50.042 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":852736644},{"type":"v1","addr":"172.21.15.139:6801","nonce":852736644}]},"active_addr":"172.21.15.139:6801/852736644","active_change":"2024-09-21T01:49:19.296952+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":918069464}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":1081101812}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":937304766}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.139:0","nonce":1002623075}]}]} 2024-09-21T01:49:50.046 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T01:49:50.046 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T01:49:50.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.160+0000 7fe153362640 1 -- 172.21.15.40:0/1547851263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 msgr2=0x7fe14c0ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.160+0000 7fe153362640 1 --2- 172.21.15.40:0/1547851263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 0x7fe14c0ce660 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0b1f10 tx=0x7fe13c02a4a0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.160+0000 7fe153362640 1 -- 172.21.15.40:0/1547851263 shutdown_connections 2024-09-21T01:49:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.160+0000 7fe153362640 1 --2- 172.21.15.40:0/1547851263 >> v2:172.21.15.139:3300/0 conn(0x7fe14c0b40f0 0x7fe14c06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.160+0000 7fe153362640 1 --2- 172.21.15.40:0/1547851263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 0x7fe14c0ce660 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.160+0000 7fe153362640 1 -- 172.21.15.40:0/1547851263 >> 172.21.15.40:0/1547851263 conn(0x7fe14c0d12a0 msgr2=0x7fe14c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.161+0000 7fe153362640 1 -- 172.21.15.40:0/1547851263 shutdown_connections 2024-09-21T01:49:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.161+0000 7fe153362640 1 -- 172.21.15.40:0/1547851263 wait complete. 2024-09-21T01:49:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.162+0000 7fe153362640 1 Processor -- start 2024-09-21T01:49:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.162+0000 7fe153362640 1 -- start start 2024-09-21T01:49:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe153362640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe14c0b40f0 0x7fe14c14c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe153362640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 0x7fe14c0af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe153362640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe14c0b66f0 0x7fe14c149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe153362640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c06d4a0 con 0x7fe14c0b60b0 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe153362640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c06d320 con 0x7fe14c0b66f0 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe153362640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fe14c06d620 con 0x7fe14c0b40f0 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1508fd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 0x7fe14c0af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1508fd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 0x7fe14c0af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50930/0 (socket says 172.21.15.40:50930) 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1508fd640 1 -- 172.21.15.40:0/1574214808 learned_addr learned my addr 172.21.15.40:0/1574214808 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1518ff640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe14c0b66f0 0x7fe14c149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1510fe640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe14c0b40f0 0x7fe14c14c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1508fd640 1 -- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe14c0b40f0 msgr2=0x7fe14c14c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1508fd640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe14c0b40f0 0x7fe14c14c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1508fd640 1 -- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe14c0b66f0 msgr2=0x7fe14c149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1508fd640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe14c0b66f0 0x7fe14c149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1508fd640 1 -- 172.21.15.40:0/1574214808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c1f6cd0 con 0x7fe14c0b60b0 2024-09-21T01:49:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe1508fd640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 0x7fe14c0af080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe13c02aa90 tx=0x7fe13c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe141ffb640 1 -- 172.21.15.40:0/1574214808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c005c90 con 0x7fe14c0b60b0 2024-09-21T01:49:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe141ffb640 1 -- 172.21.15.40:0/1574214808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe13c031e50 con 0x7fe14c0b60b0 2024-09-21T01:49:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c14cf60 con 0x7fe14c0b60b0 2024-09-21T01:49:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.164+0000 7fe141ffb640 1 -- 172.21.15.40:0/1574214808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c005240 con 0x7fe14c0b60b0 2024-09-21T01:49:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.165+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c14d520 con 0x7fe14c0b60b0 2024-09-21T01:49:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.166+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14c14ccd0 con 0x7fe14c0b60b0 2024-09-21T01:49:50.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.166+0000 7fe141ffb640 1 -- 172.21.15.40:0/1574214808 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe13c0053e0 con 0x7fe14c0b60b0 2024-09-21T01:49:50.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.167+0000 7fe141ffb640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe130078bc0 0x7fe13007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.167+0000 7fe141ffb640 1 -- 172.21.15.40:0/1574214808 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe13c0bbd40 con 0x7fe14c0b60b0 2024-09-21T01:49:50.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.167+0000 7fe1510fe640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe130078bc0 0x7fe13007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.168+0000 7fe1510fe640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe130078bc0 0x7fe13007b0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1480015b0 tx=0x7fe148009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.172+0000 7fe141ffb640 1 -- 172.21.15.40:0/1574214808 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe13c03f030 con 0x7fe14c0b60b0 2024-09-21T01:49:50.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.360+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe14c06dad0 con 0x7fe14c0b60b0 2024-09-21T01:49:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.361+0000 7fe141ffb640 1 -- 172.21.15.40:0/1574214808 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7fe13c031770 con 0x7fe14c0b60b0 2024-09-21T01:49:50.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:50.363 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:41.342237+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:49:37.635417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:49:38.682453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:50.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe130078bc0 msgr2=0x7fe13007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe130078bc0 0x7fe13007b0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1480015b0 tx=0x7fe148009040 comp rx=0 tx=0).stop 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 msgr2=0x7fe14c0af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 0x7fe14c0af080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe13c02aa90 tx=0x7fe13c033c20 comp rx=0 tx=0).stop 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 shutdown_connections 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe130078bc0 0x7fe13007b0d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe14c0b66f0 0x7fe14c149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe14c0b60b0 0x7fe14c0af080 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 --2- 172.21.15.40:0/1574214808 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe14c0b40f0 0x7fe14c14c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 >> 172.21.15.40:0/1574214808 conn(0x7fe14c0d12a0 msgr2=0x7fe14c070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 shutdown_connections 2024-09-21T01:49:50.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.363+0000 7fe153362640 1 -- 172.21.15.40:0/1574214808 wait complete. 2024-09-21T01:49:50.376 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T01:49:50.376 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:50.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.490+0000 7f9bf2beb640 1 -- 172.21.15.40:0/2656092151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aeb00 msgr2=0x7f9bec0b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.490+0000 7f9bf2beb640 1 --2- 172.21.15.40:0/2656092151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aeb00 0x7f9bec0b1e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc005fd0 tx=0x7f9bdc02a820 comp rx=0 tx=0).stop 2024-09-21T01:49:50.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.490+0000 7f9bf2beb640 1 -- 172.21.15.40:0/2656092151 shutdown_connections 2024-09-21T01:49:50.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.490+0000 7f9bf2beb640 1 --2- 172.21.15.40:0/2656092151 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aeb00 0x7f9bec0b1e10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.490+0000 7f9bf2beb640 1 --2- 172.21.15.40:0/2656092151 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bec15b8c0 0x7f9bec09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.490+0000 7f9bf2beb640 1 -- 172.21.15.40:0/2656092151 >> 172.21.15.40:0/2656092151 conn(0x7f9bec06ea80 msgr2=0x7f9bec0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.490+0000 7f9bf2beb640 1 -- 172.21.15.40:0/2656092151 shutdown_connections 2024-09-21T01:49:50.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.490+0000 7f9bf2beb640 1 -- 172.21.15.40:0/2656092151 wait complete. 2024-09-21T01:49:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.492+0000 7f9bf2beb640 1 Processor -- start 2024-09-21T01:49:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.492+0000 7f9bf2beb640 1 -- start start 2024-09-21T01:49:50.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bf2beb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bec0aeb00 0x7f9bec1f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bf2beb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aef10 0x7f9bec14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bf2beb640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bec15b8c0 0x7f9bec14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bf2beb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec15fa30 con 0x7f9bec0aef10 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bf2beb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec15f8b0 con 0x7f9bec0aeb00 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bf2beb640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f9bec15fbb0 con 0x7f9bec15b8c0 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aef10 0x7f9bec14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aef10 0x7f9bec14f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33190/0 (socket says 172.21.15.40:33190) 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bebfff640 1 -- 172.21.15.40:0/433735895 learned_addr learned my addr 172.21.15.40:0/433735895 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bf0987640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bec0aeb00 0x7f9bec1f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bf1188640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bec15b8c0 0x7f9bec14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bebfff640 1 -- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bec15b8c0 msgr2=0x7f9bec14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bebfff640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bec15b8c0 0x7f9bec14f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bebfff640 1 -- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bec0aeb00 msgr2=0x7f9bec1f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bebfff640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bec0aeb00 0x7f9bec1f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bebfff640 1 -- 172.21.15.40:0/433735895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec14c8c0 con 0x7f9bec0aef10 2024-09-21T01:49:50.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.494+0000 7f9bebfff640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aef10 0x7f9bec14f0e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc035040 tx=0x7f9bdc032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.495+0000 7f9be97fa640 1 -- 172.21.15.40:0/433735895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc037040 con 0x7f9bec0aef10 2024-09-21T01:49:50.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.495+0000 7f9be97fa640 1 -- 172.21.15.40:0/433735895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bdc042070 con 0x7f9bec0aef10 2024-09-21T01:49:50.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.495+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bec14cba0 con 0x7f9bec0aef10 2024-09-21T01:49:50.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.495+0000 7f9be97fa640 1 -- 172.21.15.40:0/433735895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0042a0 con 0x7f9bec0aef10 2024-09-21T01:49:50.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.495+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bec14d160 con 0x7f9bec0aef10 2024-09-21T01:49:50.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.496+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bec0b3d80 con 0x7f9bec0aef10 2024-09-21T01:49:50.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.496+0000 7f9be97fa640 1 -- 172.21.15.40:0/433735895 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9bdc004440 con 0x7f9bec0aef10 2024-09-21T01:49:50.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.497+0000 7f9be97fa640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9bcc078bc0 0x7f9bcc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.497+0000 7f9be97fa640 1 -- 172.21.15.40:0/433735895 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9bdc0bbce0 con 0x7f9bec0aef10 2024-09-21T01:49:50.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.497+0000 7f9bf0987640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9bcc078bc0 0x7f9bcc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.498+0000 7f9bf0987640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9bcc078bc0 0x7f9bcc07b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9be4005fd0 tx=0x7f9be4005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.502+0000 7f9be97fa640 1 -- 172.21.15.40:0/433735895 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9bdc084270 con 0x7f9bec0aef10 2024-09-21T01:49:50.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.689+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9bec1600d0 con 0x7f9bec0aef10 2024-09-21T01:49:50.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.690+0000 7f9be97fa640 1 -- 172.21.15.40:0/433735895 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7f9bdc083b70 con 0x7f9bec0aef10 2024-09-21T01:49:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:50.692 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:41.342237+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:49:37.635417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:49:38.682453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9bcc078bc0 msgr2=0x7f9bcc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9bcc078bc0 0x7f9bcc07b0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9be4005fd0 tx=0x7f9be4005850 comp rx=0 tx=0).stop 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aef10 msgr2=0x7f9bec14f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aef10 0x7f9bec14f0e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc035040 tx=0x7f9bdc032c90 comp rx=0 tx=0).stop 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 shutdown_connections 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9bcc078bc0 0x7f9bcc07b0d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9bec15b8c0 0x7f9bec14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9bec0aef10 0x7f9bec14f0e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 --2- 172.21.15.40:0/433735895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9bec0aeb00 0x7f9bec1f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 >> 172.21.15.40:0/433735895 conn(0x7f9bec06ea80 msgr2=0x7f9bec0714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 shutdown_connections 2024-09-21T01:49:50.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.693+0000 7f9bf2beb640 1 -- 172.21.15.40:0/433735895 wait complete. 2024-09-21T01:49:50.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T01:49:50.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T01:49:50.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T01:49:50.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T01:49:50.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T01:49:50.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T01:49:50.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T01:49:50.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T01:49:50.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f049ed9b640 1 -- 172.21.15.40:0/3366436791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049816ec30 msgr2=0x7f04980747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f049ed9b640 1 --2- 172.21.15.40:0/3366436791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049816ec30 0x7f04980747d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0490013fd0 tx=0x7f0490032f10 comp rx=0 tx=0).stop 2024-09-21T01:49:50.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f3b83cd5640 1 -- 172.21.15.40:0/1964190804 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b7c0cfba0 msgr2=0x7f3b7c0cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f3b83cd5640 1 --2- 172.21.15.40:0/1964190804 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b7c0cfba0 0x7f3b7c0cffb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3b74005fd0 tx=0x7f3b7402a9a0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f3b83cd5640 1 -- 172.21.15.40:0/1964190804 shutdown_connections 2024-09-21T01:49:50.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f3b83cd5640 1 --2- 172.21.15.40:0/1964190804 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b7c0cfba0 0x7f3b7c0cffb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f3b83cd5640 1 --2- 172.21.15.40:0/1964190804 >> v2:172.21.15.139:3300/0 conn(0x7f3b7c0b3560 0x7f3b7c0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f3b83cd5640 1 -- 172.21.15.40:0/1964190804 >> 172.21.15.40:0/1964190804 conn(0x7f3b7c08bfc0 msgr2=0x7f3b7c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f049ed9b640 1 -- 172.21.15.40:0/3366436791 shutdown_connections 2024-09-21T01:49:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f049ed9b640 1 --2- 172.21.15.40:0/3366436791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049816ec30 0x7f04980747d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f049ed9b640 1 -- 172.21.15.40:0/3366436791 >> 172.21.15.40:0/3366436791 conn(0x7f049806d410 msgr2=0x7f04980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f049ed9b640 1 -- 172.21.15.40:0/3366436791 shutdown_connections 2024-09-21T01:49:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.934+0000 7f049ed9b640 1 -- 172.21.15.40:0/3366436791 wait complete. 2024-09-21T01:49:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.935+0000 7f3b83cd5640 1 -- 172.21.15.40:0/1964190804 shutdown_connections 2024-09-21T01:49:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.935+0000 7f3b83cd5640 1 -- 172.21.15.40:0/1964190804 wait complete. 2024-09-21T01:49:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.937+0000 7f049ed9b640 1 Processor -- start 2024-09-21T01:49:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.938+0000 7f049ed9b640 1 -- start start 2024-09-21T01:49:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.938+0000 7f554d3dd640 1 -- 172.21.15.40:0/2628745708 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55480b77d0 msgr2=0x7f55480b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.938+0000 7f554d3dd640 1 --2- 172.21.15.40:0/2628745708 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55480b77d0 0x7f55480b1450 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5538009900 tx=0x7f553802a5c0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f3b83cd5640 1 Processor -- start 2024-09-21T01:49:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f3b83cd5640 1 -- start start 2024-09-21T01:49:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f84b2107640 1 -- 172.21.15.40:0/2714554511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84a4006cc0 msgr2=0x7f84a40070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f84b2107640 1 --2- 172.21.15.40:0/2714554511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84a4006cc0 0x7f84a40070d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f84ac06ad50 tx=0x7f84ac0a6590 comp rx=0 tx=0).stop 2024-09-21T01:49:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f84b2107640 1 -- 172.21.15.40:0/2714554511 shutdown_connections 2024-09-21T01:49:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f84b2107640 1 --2- 172.21.15.40:0/2714554511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84a4006cc0 0x7f84a40070d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f84b2107640 1 -- 172.21.15.40:0/2714554511 >> 172.21.15.40:0/2714554511 conn(0x7f84a4051420 msgr2=0x7f84a4051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f554d3dd640 1 -- 172.21.15.40:0/2628745708 shutdown_connections 2024-09-21T01:49:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f554d3dd640 1 --2- 172.21.15.40:0/2628745708 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55480b77d0 0x7f55480b1450 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f554d3dd640 1 -- 172.21.15.40:0/2628745708 >> 172.21.15.40:0/2628745708 conn(0x7f55480b3c50 msgr2=0x7f55480b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f554d3dd640 1 -- 172.21.15.40:0/2628745708 shutdown_connections 2024-09-21T01:49:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.939+0000 7f554d3dd640 1 -- 172.21.15.40:0/2628745708 wait complete. 2024-09-21T01:49:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.940+0000 7f8d8cb61640 1 -- 172.21.15.40:0/4256905942 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8d780051c0 msgr2=0x7f8d7800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.940+0000 7f8d8cb61640 1 --2- 172.21.15.40:0/4256905942 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8d780051c0 0x7f8d7800b9c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d8806ad50 tx=0x7f8d78005830 comp rx=0 tx=0).stop 2024-09-21T01:49:50.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.940+0000 7f8d87fff640 1 -- 172.21.15.40:0/4256905942 reap_dead start 2024-09-21T01:49:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.940+0000 7f049ed9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0498074d10 0x7f049809bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f049ed9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049816e820 0x7f0498201f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f049ed9b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f049816ec30 0x7f0498158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f049cb37640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0498074d10 0x7f049809bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f049ed9b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0498073d80 con 0x7f0498074d10 2024-09-21T01:49:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f049ed9b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0498073c00 con 0x7f049816e820 2024-09-21T01:49:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f049ed9b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f0498073f00 con 0x7f049816ec30 2024-09-21T01:49:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.940+0000 7f8d8cb61640 1 -- 172.21.15.40:0/4256905942 shutdown_connections 2024-09-21T01:49:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.940+0000 7f8d8cb61640 1 -- 172.21.15.40:0/4256905942 >> 172.21.15.40:0/4256905942 conn(0x7f8d800569f0 msgr2=0x7f8d80056e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f84b2107640 1 -- 172.21.15.40:0/2714554511 shutdown_connections 2024-09-21T01:49:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f84b2107640 1 -- 172.21.15.40:0/2714554511 wait complete. 2024-09-21T01:49:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f8d8cb61640 1 -- 172.21.15.40:0/4256905942 shutdown_connections 2024-09-21T01:49:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f3b83cd5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b7c0b3560 0x7f3b7c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f3b83cd5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b7c0cfba0 0x7f3b7c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f3b83cd5640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b7c0d4410 0x7f3b7c0b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f3b81a71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b7c0b3560 0x7f3b7c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f3b83cd5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c0d50b0 con 0x7f3b7c0cfba0 2024-09-21T01:49:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f3b83cd5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c0d4f30 con 0x7f3b7c0b3560 2024-09-21T01:49:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f3b81a71640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b7c0b3560 0x7f3b7c0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.40:43828/0 (socket says 172.21.15.40:43828) 2024-09-21T01:49:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f3b81a71640 1 -- 172.21.15.40:0/3812447964 learned_addr learned my addr 172.21.15.40:0/3812447964 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f3b83cd5640 1 -- 172.21.15.40:0/3812447964 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7c0c4150 con 0x7f3b7c0d4410 2024-09-21T01:49:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f049d338640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f049816ec30 0x7f0498158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f049d338640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f049816ec30 0x7f0498158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:33296/0 (socket says 172.21.15.40:33296) 2024-09-21T01:49:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f049d338640 1 -- 172.21.15.40:0/3294871767 learned_addr learned my addr 172.21.15.40:0/3294871767 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f8d8cb61640 1 -- 172.21.15.40:0/4256905942 wait complete. 2024-09-21T01:49:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f4908e5c640 1 -- 172.21.15.40:0/1331026397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040b14d0 msgr2=0x7f490409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.941+0000 7f4908e5c640 1 --2- 172.21.15.40:0/1331026397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040b14d0 0x7f490409aa30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f48f4005fd0 tx=0x7f48f402a5f0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f4908e5c640 1 -- 172.21.15.40:0/1331026397 shutdown_connections 2024-09-21T01:49:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f4908e5c640 1 --2- 172.21.15.40:0/1331026397 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49040b1f90 0x7f49040b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f4908e5c640 1 --2- 172.21.15.40:0/1331026397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040b14d0 0x7f490409aa30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f4908e5c640 1 -- 172.21.15.40:0/1331026397 >> 172.21.15.40:0/1331026397 conn(0x7f49040b3c50 msgr2=0x7f49040b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f4908e5c640 1 -- 172.21.15.40:0/1331026397 shutdown_connections 2024-09-21T01:49:50.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f554d3dd640 1 Processor -- start 2024-09-21T01:49:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f51c58d3640 1 -- 172.21.15.40:0/700118897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51ac005270 msgr2=0x7f51ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f3b81270640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b7c0cfba0 0x7f3b7c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f3b81a71640 1 -- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b7c0d4410 msgr2=0x7f3b7c0b8460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:49:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f3b81a71640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b7c0d4410 0x7f3b7c0b8460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f3b81a71640 1 -- 172.21.15.40:0/3812447964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b7c0cfba0 msgr2=0x7f3b7c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f3b81a71640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b7c0cfba0 0x7f3b7c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f51c58d3640 1 --2- 172.21.15.40:0/700118897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51ac005270 0x7f51ac00b9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51b80043e0 tx=0x7f51ac005830 comp rx=0 tx=0).stop 2024-09-21T01:49:50.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f3b81a71640 1 -- 172.21.15.40:0/3812447964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c154ff0 con 0x7f3b7c0b3560 2024-09-21T01:49:50.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f0497fff640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049816e820 0x7f0498201f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f51c58d3640 1 -- 172.21.15.40:0/700118897 shutdown_connections 2024-09-21T01:49:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f51c58d3640 1 --2- 172.21.15.40:0/700118897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51ac005270 0x7f51ac00b9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f51c58d3640 1 -- 172.21.15.40:0/700118897 >> 172.21.15.40:0/700118897 conn(0x7f51c00b20a0 msgr2=0x7f51c00b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f554d3dd640 1 -- start start 2024-09-21T01:49:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f3b81a71640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b7c0b3560 0x7f3b7c0700b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800e7c0 tx=0x7f3b7800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f0497fff640 1 -- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f049816ec30 msgr2=0x7f0498158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f51c58d3640 1 -- 172.21.15.40:0/700118897 shutdown_connections 2024-09-21T01:49:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f0497fff640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f049816ec30 0x7f0498158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f3b727fc640 1 -- 172.21.15.40:0/3812447964 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800ccc0 con 0x7f3b7c0b3560 2024-09-21T01:49:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f0497fff640 1 -- 172.21.15.40:0/3294871767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0498074d10 msgr2=0x7f049809bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f0497fff640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0498074d10 0x7f049809bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f0497fff640 1 -- 172.21.15.40:0/3294871767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049809c220 con 0x7f049816e820 2024-09-21T01:49:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f3b83cd5640 1 -- 172.21.15.40:0/3812447964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c0c3390 con 0x7f3b7c0b3560 2024-09-21T01:49:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f0497fff640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049816e820 0x7f0498201f30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f049003a000 tx=0x7f04900045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.942+0000 7f4908e5c640 1 -- 172.21.15.40:0/1331026397 wait complete. 2024-09-21T01:49:50.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f51c58d3640 1 -- 172.21.15.40:0/700118897 wait complete. 2024-09-21T01:49:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f04957fa640 1 -- 172.21.15.40:0/3294871767 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490048020 con 0x7f049816e820 2024-09-21T01:49:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f04957fa640 1 -- 172.21.15.40:0/3294871767 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04900047e0 con 0x7f049816e820 2024-09-21T01:49:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f04957fa640 1 -- 172.21.15.40:0/3294871767 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490040040 con 0x7f049816e820 2024-09-21T01:49:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f049ed9b640 1 -- 172.21.15.40:0/3294871767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049809c6a0 con 0x7f049816e820 2024-09-21T01:49:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.943+0000 7f049ed9b640 1 -- 172.21.15.40:0/3294871767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049809cc60 con 0x7f049816e820 2024-09-21T01:49:50.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.944+0000 7f8d8cb61640 1 Processor -- start 2024-09-21T01:49:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.944+0000 7f84b2107640 1 Processor -- start 2024-09-21T01:49:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.944+0000 7f84b2107640 1 -- start start 2024-09-21T01:49:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.944+0000 7f3b83cd5640 1 -- 172.21.15.40:0/3812447964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c0c3950 con 0x7f3b7c0b3560 2024-09-21T01:49:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.944+0000 7f8d8cb61640 1 -- start start 2024-09-21T01:49:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f3b727fc640 1 -- 172.21.15.40:0/3812447964 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b78010430 con 0x7f3b7c0b3560 2024-09-21T01:49:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f3b727fc640 1 -- 172.21.15.40:0/3812447964 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b78010840 con 0x7f3b7c0b3560 2024-09-21T01:49:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f049ed9b640 1 -- 172.21.15.40:0/3294871767 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04980747d0 con 0x7f049816e820 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f554d3dd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554806e100 0x7f554815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f554d3dd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f554806ec20 0x7f55481595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f554d3dd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55480b77d0 0x7f5548071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f5547fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554806e100 0x7f554815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f554d3dd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f55480b2ec0 con 0x7f554806e100 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f5547fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554806e100 0x7f554815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33282/0 (socket says 172.21.15.40:33282) 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f5547fff640 1 -- 172.21.15.40:0/2852010547 learned_addr learned my addr 172.21.15.40:0/2852010547 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f554d3dd640 1 -- 172.21.15.40:0/2852010547 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55480b2d40 con 0x7f554806ec20 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.945+0000 7f554d3dd640 1 -- 172.21.15.40:0/2852010547 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f55480b3040 con 0x7f55480b77d0 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f5547fff640 1 -- 172.21.15.40:0/2852010547 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55480b77d0 msgr2=0x7f5548071860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f5547fff640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f55480b77d0 0x7f5548071860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f5547fff640 1 -- 172.21.15.40:0/2852010547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f554806ec20 msgr2=0x7f55481595e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:49:50.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f5547fff640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f554806ec20 0x7f55481595e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f5547fff640 1 -- 172.21.15.40:0/2852010547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554815aa30 con 0x7f554806e100 2024-09-21T01:49:50.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f51c58d3640 1 Processor -- start 2024-09-21T01:49:50.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f4908e5c640 1 Processor -- start 2024-09-21T01:49:50.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f5547fff640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554806e100 0x7f554815a4f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5538034040 tx=0x7f55380038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f3b83cd5640 1 -- 172.21.15.40:0/3812447964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b64001030 con 0x7f3b7c0b3560 2024-09-21T01:49:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f04957fa640 1 -- 172.21.15.40:0/3294871767 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f049004b020 con 0x7f049816e820 2024-09-21T01:49:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f5544ff9640 1 -- 172.21.15.40:0/2852010547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553803e030 con 0x7f554806e100 2024-09-21T01:49:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f3347454640 1 -- 172.21.15.40:0/4199355588 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f332c0048a0 msgr2=0x7f332c004d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f554d3dd640 1 -- 172.21.15.40:0/2852010547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554815af40 con 0x7f554806e100 2024-09-21T01:49:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f5544ff9640 1 -- 172.21.15.40:0/2852010547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5538003d90 con 0x7f554806e100 2024-09-21T01:49:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f554d3dd640 1 -- 172.21.15.40:0/2852010547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f554815f590 con 0x7f554806e100 2024-09-21T01:49:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f3347454640 1 --2- 172.21.15.40:0/4199355588 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f332c0048a0 0x7f332c004d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3340072a00 tx=0x7f332c005830 comp rx=0 tx=0).stop 2024-09-21T01:49:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f5544ff9640 1 -- 172.21.15.40:0/2852010547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538035040 con 0x7f554806e100 2024-09-21T01:49:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.946+0000 7f51c58d3640 1 -- start start 2024-09-21T01:49:50.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f4908e5c640 1 -- start start 2024-09-21T01:49:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f04957fa640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0484078bc0 0x7f048407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f8d8cb61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d780051c0 0x7f8d80034bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f04957fa640 1 -- 172.21.15.40:0/3294871767 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04900c3b00 con 0x7f049816e820 2024-09-21T01:49:50.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f8d8cb61640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d800e1100 0x7f8d800d6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f04957fa640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.40:6808/3415875567,v1:172.21.15.40:6809/3415875567] conn(0x7f0484080db0 0x7f0484083200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f04957fa640 1 -- 172.21.15.40:0/3294871767 --> [v2:172.21.15.40:6808/3415875567,v1:172.21.15.40:6809/3415875567] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f049004bec0 con 0x7f0484080db0 2024-09-21T01:49:50.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f8d877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d780051c0 0x7f8d80034bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f8d877fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d780051c0 0x7f8d80034bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.40:43836/0 (socket says 172.21.15.40:43836) 2024-09-21T01:49:50.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.947+0000 7f04957fa640 1 -- 172.21.15.40:0/3294871767 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f04900c82c0 con 0x7f049816e820 2024-09-21T01:49:50.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f049d338640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.40:6808/3415875567,v1:172.21.15.40:6809/3415875567] conn(0x7f0484080db0 0x7f0484083200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f049cb37640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0484078bc0 0x7f048407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b2107640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84a4006cc0 0x7f84a40deca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b2107640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84a400b070 0x7f84a41790b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b2107640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f84a400b550 0x7f84a41795f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b2107640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84a401c5b0 con 0x7f84a4006cc0 2024-09-21T01:49:50.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b2107640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f84a4038fb0 con 0x7f84a400b070 2024-09-21T01:49:50.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b2107640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f84a401c730 con 0x7f84a400b550 2024-09-21T01:49:50.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f8d86ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d800e1100 0x7f8d800d6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f8d86ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d800e1100 0x7f8d800d6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33288/0 (socket says 172.21.15.40:33288) 2024-09-21T01:49:50.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f8d877fe640 1 -- 172.21.15.40:0/1651793473 learned_addr learned my addr 172.21.15.40:0/1651793473 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b0904640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84a400b070 0x7f84a41790b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b1105640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84a4006cc0 0x7f84a40deca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b0904640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84a400b070 0x7f84a41790b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.40:43846/0 (socket says 172.21.15.40:43846) 2024-09-21T01:49:50.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b0904640 1 -- 172.21.15.40:0/2216010315 learned_addr learned my addr 172.21.15.40:0/2216010315 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f049d338640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.40:6808/3415875567,v1:172.21.15.40:6809/3415875567] conn(0x7f0484080db0 0x7f0484083200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f84b1906640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f84a400b550 0x7f84a41795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f8d8cb61640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8d800d8ae0 0x7f8d800d8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f554d3dd640 1 -- 172.21.15.40:0/2852010547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55480b1450 con 0x7f554806e100 2024-09-21T01:49:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f8d8cb61640 1 -- 172.21.15.40:0/1651793473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8d80052ba0 con 0x7f8d800e1100 2024-09-21T01:49:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f4908e5c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49040b14d0 0x7f49040c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f8d87fff640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8d800d8ae0 0x7f8d800d8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f8d8cb61640 1 -- 172.21.15.40:0/1651793473 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8d80052a20 con 0x7f8d780051c0 2024-09-21T01:49:50.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f8d8cb61640 1 -- 172.21.15.40:0/1651793473 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f8d80055300 con 0x7f8d800d8ae0 2024-09-21T01:49:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f49037fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49040b14d0 0x7f49040c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f49037fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49040b14d0 0x7f49040c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:33348/0 (socket says 172.21.15.40:33348) 2024-09-21T01:49:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f4908e5c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b1f90 0x7f49040c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f49037fe640 1 -- 172.21.15.40:0/4293305126 learned_addr learned my addr 172.21.15.40:0/4293305126 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f4908e5c640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040b7590 0x7f4904152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f48fbfff640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b1f90 0x7f49040c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.948+0000 7f049cb37640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0484078bc0 0x7f048407b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0488000f60 tx=0x7f0488009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f4903fff640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040b7590 0x7f4904152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f49040b2a60 con 0x7f49040b1f90 2024-09-21T01:49:50.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f49040b28e0 con 0x7f49040b7590 2024-09-21T01:49:50.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f49040b2be0 con 0x7f49040b14d0 2024-09-21T01:49:50.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f04957fa640 1 -- 172.21.15.40:0/3294871767 <== osd.2 v2:172.21.15.40:6808/3415875567 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f049004bec0 con 0x7f0484080db0 2024-09-21T01:49:50.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f3b727fc640 1 -- 172.21.15.40:0/3812447964 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b780109e0 con 0x7f3b7c0b3560 2024-09-21T01:49:50.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f84b1105640 1 -- 172.21.15.40:0/2216010315 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f84a400b550 msgr2=0x7f84a41795f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f84b1105640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f84a400b550 0x7f84a41795f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f84b1105640 1 -- 172.21.15.40:0/2216010315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84a400b070 msgr2=0x7f84a41790b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f84b1105640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f84a400b070 0x7f84a41790b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f84b1105640 1 -- 172.21.15.40:0/2216010315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a4168c50 con 0x7f84a4006cc0 2024-09-21T01:49:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.949+0000 7f84b1105640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84a4006cc0 0x7f84a40deca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84a8001530 tx=0x7f84a800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f3347454640 1 -- 172.21.15.40:0/4199355588 shutdown_connections 2024-09-21T01:49:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f3347454640 1 --2- 172.21.15.40:0/4199355588 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f332c0048a0 0x7f332c004d70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f3347454640 1 -- 172.21.15.40:0/4199355588 >> 172.21.15.40:0/4199355588 conn(0x7f3340070b20 msgr2=0x7f3340070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f8d86ffd640 1 -- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8d800d8ae0 msgr2=0x7f8d800d8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51c58d3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ac005270 0x7f51c01ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51c58d3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51c0202bb0 0x7f51c00c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51c58d3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f51c00c26f0 0x7f51c00c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51bf7fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f51c00c26f0 0x7f51c00c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f3b727fc640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b60078be0 0x7f3b6007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51c58d3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f51c00cd580 con 0x7f51ac005270 2024-09-21T01:49:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51c58d3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f51c00cd400 con 0x7f51c0202bb0 2024-09-21T01:49:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51c58d3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f51c00af3e0 con 0x7f51c00c26f0 2024-09-21T01:49:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f8d86ffd640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8d800d8ae0 0x7f8d800d8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f8d86ffd640 1 -- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d780051c0 msgr2=0x7f8d80034bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f8d86ffd640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d780051c0 0x7f8d80034bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f8d86ffd640 1 -- 172.21.15.40:0/1651793473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d800d9430 con 0x7f8d800e1100 2024-09-21T01:49:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f3b727fc640 1 -- 172.21.15.40:0/3812447964 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3b7809bf00 con 0x7f3b7c0b3560 2024-09-21T01:49:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f3b727fc640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.40:6824/238312773,v1:172.21.15.40:6825/238312773] conn(0x7f3b60080e50 0x7f3b600832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f3b727fc640 1 -- 172.21.15.40:0/3812447964 --> [v2:172.21.15.40:6824/238312773,v1:172.21.15.40:6825/238312773] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b78022e50 con 0x7f3b60080e50 2024-09-21T01:49:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f3b727fc640 1 -- 172.21.15.40:0/3812447964 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3b7809c3e0 con 0x7f3b7c0b3560 2024-09-21T01:49:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51c0202bb0 0x7f51c00c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51beffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ac005270 0x7f51c01ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51b7fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51c0202bb0 0x7f51c00c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.40:43866/0 (socket says 172.21.15.40:43866) 2024-09-21T01:49:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f51b7fff640 1 -- 172.21.15.40:0/2023076451 learned_addr learned my addr 172.21.15.40:0/2023076451 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f3b81270640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b60078be0 0x7f3b6007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f8d86ffd640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d800e1100 0x7f8d800d6e50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d740036d0 tx=0x7f8d74003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f3b82272640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.40:6824/238312773,v1:172.21.15.40:6825/238312773] conn(0x7f3b60080e50 0x7f3b600832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f4903fff640 1 -- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49040b14d0 msgr2=0x7f49040c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f4903fff640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f49040b14d0 0x7f49040c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f4903fff640 1 -- 172.21.15.40:0/4293305126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b1f90 msgr2=0x7f49040c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f4903fff640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b1f90 0x7f49040c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f4903fff640 1 -- 172.21.15.40:0/4293305126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49040c6450 con 0x7f49040b7590 2024-09-21T01:49:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f5544ff9640 1 -- 172.21.15.40:0/2852010547 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5538041030 con 0x7f554806e100 2024-09-21T01:49:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f5544ff9640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5534078b90 0x7f553407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f5544ff9640 1 -- 172.21.15.40:0/2852010547 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f55380bb440 con 0x7f554806e100 2024-09-21T01:49:50.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f55477fe640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5534078b90 0x7f553407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f5544ff9640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.40:6816/3104901496,v1:172.21.15.40:6817/3104901496] conn(0x7f5534080d80 0x7f55340831d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f5544ff9640 1 -- 172.21.15.40:0/2852010547 --> [v2:172.21.15.40:6816/3104901496,v1:172.21.15.40:6817/3104901496] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f553803ae50 con 0x7f5534080d80 2024-09-21T01:49:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f8d73fff640 1 -- 172.21.15.40:0/1651793473 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74015070 con 0x7f8d800e1100 2024-09-21T01:49:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f8d73fff640 1 -- 172.21.15.40:0/1651793473 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d7400f8d0 con 0x7f8d800e1100 2024-09-21T01:49:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f51b7fff640 1 -- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f51c00c26f0 msgr2=0x7f51c00c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f51b7fff640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f51c00c26f0 0x7f51c00c1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f51b7fff640 1 -- 172.21.15.40:0/2023076451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ac005270 msgr2=0x7f51c01ff6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f51b7fff640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ac005270 0x7f51c01ff6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f51b7fff640 1 -- 172.21.15.40:0/2023076451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c0203100 con 0x7f51c0202bb0 2024-09-21T01:49:50.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f51beffd640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ac005270 0x7f51c01ff6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:50.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f8d8cb61640 1 -- 172.21.15.40:0/1651793473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d800e00a0 con 0x7f8d800e1100 2024-09-21T01:49:50.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f8d8cb61640 1 -- 172.21.15.40:0/1651793473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d800e0660 con 0x7f8d800e1100 2024-09-21T01:49:50.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f8d73fff640 1 -- 172.21.15.40:0/1651793473 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400fce0 con 0x7f8d800e1100 2024-09-21T01:49:50.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f51b7fff640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51c0202bb0 0x7f51c00c1a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f51a8011860 tx=0x7f51a8011d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f3347454640 1 -- 172.21.15.40:0/4199355588 shutdown_connections 2024-09-21T01:49:50.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f3347454640 1 -- 172.21.15.40:0/4199355588 wait complete. 2024-09-21T01:49:50.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.952+0000 7f554cbdc640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.40:6816/3104901496,v1:172.21.15.40:6817/3104901496] conn(0x7f5534080d80 0x7f55340831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.952+0000 7f55477fe640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5534078b90 0x7f553407b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55480cf500 tx=0x7f553c007860 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f3b82272640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.40:6824/238312773,v1:172.21.15.40:6825/238312773] conn(0x7f3b60080e50 0x7f3b600832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.950+0000 7f84a1ffb640 1 -- 172.21.15.40:0/2216010315 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8017070 con 0x7f84a4006cc0 2024-09-21T01:49:50.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f84a1ffb640 1 -- 172.21.15.40:0/2216010315 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84a80035f0 con 0x7f84a4006cc0 2024-09-21T01:49:50.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.951+0000 7f84a1ffb640 1 -- 172.21.15.40:0/2216010315 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a8003a60 con 0x7f84a4006cc0 2024-09-21T01:49:50.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.952+0000 7f84b2107640 1 -- 172.21.15.40:0/2216010315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a401e660 con 0x7f84a4006cc0 2024-09-21T01:49:50.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.952+0000 7f5544ff9640 1 -- 172.21.15.40:0/2852010547 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f55380c2050 con 0x7f554806e100 2024-09-21T01:49:50.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.952+0000 7f84b2107640 1 -- 172.21.15.40:0/2216010315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a4179ea0 con 0x7f84a4006cc0 2024-09-21T01:49:50.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.954+0000 7f848f7fe640 1 -- 172.21.15.40:0/2216010315 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84a40070d0 con 0x7f84a4006cc0 2024-09-21T01:49:50.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.952+0000 7f554cbdc640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.40:6816/3104901496,v1:172.21.15.40:6817/3104901496] conn(0x7f5534080d80 0x7f55340831d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.953+0000 7f8d8cb61640 1 -- 172.21.15.40:0/1651793473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d68001030 con 0x7f8d800e1100 2024-09-21T01:49:50.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.953+0000 7f3b81270640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b60078be0 0x7f3b6007b0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b74035000 tx=0x7f3b7403a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.953+0000 7f3b727fc640 1 -- 172.21.15.40:0/3812447964 <== osd.0 v2:172.21.15.40:6824/238312773 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b78022e50 con 0x7f3b60080e50 2024-09-21T01:49:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.954+0000 7f5544ff9640 1 -- 172.21.15.40:0/2852010547 <== osd.3 v2:172.21.15.40:6816/3104901496 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f553803ae50 con 0x7f5534080d80 2024-09-21T01:49:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.954+0000 7f3347454640 1 Processor -- start 2024-09-21T01:49:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.954+0000 7f3347454640 1 -- start start 2024-09-21T01:49:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.954+0000 7f51bcff9640 1 -- 172.21.15.40:0/2023076451 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a800fe70 con 0x7f51c0202bb0 2024-09-21T01:49:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.954+0000 7f51bcff9640 1 -- 172.21.15.40:0/2023076451 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51a8005020 con 0x7f51c0202bb0 2024-09-21T01:49:50.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.954+0000 7f51bcff9640 1 -- 172.21.15.40:0/2023076451 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8005450 con 0x7f51c0202bb0 2024-09-21T01:49:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.954+0000 7f51c58d3640 1 -- 172.21.15.40:0/2023076451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c00c24c0 con 0x7f51c0202bb0 2024-09-21T01:49:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.954+0000 7f51c58d3640 1 -- 172.21.15.40:0/2023076451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c02033a0 con 0x7f51c0202bb0 2024-09-21T01:49:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.955+0000 7f4903fff640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040b7590 0x7f4904152820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00be20 tx=0x7f48fc00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.955+0000 7f8d73fff640 1 -- 172.21.15.40:0/1651793473 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d74011430 con 0x7f8d800e1100 2024-09-21T01:49:50.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.955+0000 7f51b5ffb640 1 -- 172.21.15.40:0/2023076451 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51c00cd700 con 0x7f51c0202bb0 2024-09-21T01:49:50.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.955+0000 7f84a1ffb640 1 -- 172.21.15.40:0/2216010315 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84a801a070 con 0x7f84a4006cc0 2024-09-21T01:49:50.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.955+0000 7f8d73fff640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8d6c078bc0 0x7f8d6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.955+0000 7f4900ff9640 1 -- 172.21.15.40:0/4293305126 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc019070 con 0x7f49040b7590 2024-09-21T01:49:50.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f4900ff9640 1 -- 172.21.15.40:0/4293305126 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48fc014440 con 0x7f49040b7590 2024-09-21T01:49:50.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f4900ff9640 1 -- 172.21.15.40:0/4293305126 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48fc014890 con 0x7f49040b7590 2024-09-21T01:49:50.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f8d73fff640 1 -- 172.21.15.40:0/1651793473 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8d7409b940 con 0x7f8d800e1100 2024-09-21T01:49:50.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f8d73fff640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6810/3827934146,v1:172.21.15.139:6811/3827934146] conn(0x7f8d6c080e30 0x7f8d6c083280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f8d73fff640 1 -- 172.21.15.40:0/1651793473 --> [v2:172.21.15.139:6810/3827934146,v1:172.21.15.139:6811/3827934146] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d6c083950 con 0x7f8d6c080e30 2024-09-21T01:49:50.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f8d73fff640 1 -- 172.21.15.40:0/1651793473 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8d740a02a0 con 0x7f8d800e1100 2024-09-21T01:49:50.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49040c6730 con 0x7f49040b7590 2024-09-21T01:49:50.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49040c6cf0 con 0x7f49040b7590 2024-09-21T01:49:50.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f8d87fff640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6810/3827934146,v1:172.21.15.139:6811/3827934146] conn(0x7f8d6c080e30 0x7f8d6c083280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f8d877fe640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8d6c078bc0 0x7f8d6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3347454640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f332c0048a0 0x7f33401468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3347454640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3340151f70 0x7f33401575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f84a1ffb640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8490078c60 0x7f849007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.956+0000 7f84a1ffb640 1 -- 172.21.15.40:0/2216010315 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84a8099ff0 con 0x7f84a4006cc0 2024-09-21T01:49:50.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f84a1ffb640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.40:6800/2884298880,v1:172.21.15.40:6801/2884298880] conn(0x7f8490080f30 0x7f8490083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f84a1ffb640 1 -- 172.21.15.40:0/2216010315 --> [v2:172.21.15.40:6800/2884298880,v1:172.21.15.40:6801/2884298880] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8490083a50 con 0x7f8490080f30 2024-09-21T01:49:50.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f84a1ffb640 1 -- 172.21.15.40:0/2216010315 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f84a809c5f0 con 0x7f84a4006cc0 2024-09-21T01:49:50.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f84b1906640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.40:6800/2884298880,v1:172.21.15.40:6801/2884298880] conn(0x7f8490080f30 0x7f8490083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3346452640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f332c0048a0 0x7f33401468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3346452640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f332c0048a0 0x7f33401468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:33366/0 (socket says 172.21.15.40:33366) 2024-09-21T01:49:50.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3346452640 1 -- 172.21.15.40:0/3898621793 learned_addr learned my addr 172.21.15.40:0/3898621793 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:50.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3347454640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3340152380 0x7f3340157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3345c51640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3340151f70 0x7f33401575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f334006f280 con 0x7f3340151f70 2024-09-21T01:49:50.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f33400d05a0 con 0x7f3340152380 2024-09-21T01:49:50.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f334006f400 con 0x7f332c0048a0 2024-09-21T01:49:50.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f8d87fff640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6810/3827934146,v1:172.21.15.139:6811/3827934146] conn(0x7f8d6c080e30 0x7f8d6c083280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f8d877fe640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8d6c078bc0 0x7f8d6c07b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c005f70 tx=0x7f8d7c00b260 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4904152d60 con 0x7f49040b7590 2024-09-21T01:49:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f3346c53640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3340152380 0x7f3340157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.957+0000 7f84b0904640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8490078c60 0x7f849007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f84b1906640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.40:6800/2884298880,v1:172.21.15.40:6801/2884298880] conn(0x7f8490080f30 0x7f8490083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f3346452640 1 -- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3340152380 msgr2=0x7f3340157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f3346452640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3340152380 0x7f3340157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f3346452640 1 -- 172.21.15.40:0/3898621793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3340151f70 msgr2=0x7f33401575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f3346452640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3340151f70 0x7f33401575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f3346452640 1 -- 172.21.15.40:0/3898621793 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33400c9230 con 0x7f332c0048a0 2024-09-21T01:49:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f3345c51640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3340151f70 0x7f33401575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:50.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f8d73fff640 1 -- 172.21.15.40:0/1651793473 <== osd.4 v2:172.21.15.139:6810/3827934146 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d6c083950 con 0x7f8d6c080e30 2024-09-21T01:49:50.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f3346452640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f332c0048a0 0x7f33401468b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f333c006de0 tx=0x7f333c0039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:50.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.958+0000 7f3336ffd640 1 -- 172.21.15.40:0/3898621793 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c015070 con 0x7f332c0048a0 2024-09-21T01:49:50.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.959+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33400c94f0 con 0x7f332c0048a0 2024-09-21T01:49:50.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.959+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f33400c9ab0 con 0x7f332c0048a0 2024-09-21T01:49:50.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.959+0000 7f84a1ffb640 1 -- 172.21.15.40:0/2216010315 <== osd.1 v2:172.21.15.40:6800/2884298880 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8490083a50 con 0x7f8490080f30 2024-09-21T01:49:50.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.959+0000 7f51bcff9640 1 -- 172.21.15.40:0/2023076451 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51a80047a0 con 0x7f51c0202bb0 2024-09-21T01:49:50.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.959+0000 7f51bcff9640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f51a0078be0 0x7f51a007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f51beffd640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f51a0078be0 0x7f51a007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33400ca170 con 0x7f332c0048a0 2024-09-21T01:49:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.959+0000 7f4900ff9640 1 -- 172.21.15.40:0/4293305126 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f48fc01c070 con 0x7f49040b7590 2024-09-21T01:49:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f4900ff9640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f48e4078c90 0x7f48e407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f4900ff9640 1 -- 172.21.15.40:0/4293305126 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f48fc09ac50 con 0x7f49040b7590 2024-09-21T01:49:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f4900ff9640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6802/1976010004,v1:172.21.15.139:6803/1976010004] conn(0x7f48e4080ee0 0x7f48e4083330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f4900ff9640 1 -- 172.21.15.40:0/4293305126 --> [v2:172.21.15.139:6802/1976010004,v1:172.21.15.139:6803/1976010004] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48e4083a00 con 0x7f48e4080ee0 2024-09-21T01:49:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f51bcff9640 1 -- 172.21.15.40:0/2023076451 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f51a80055f0 con 0x7f51c0202bb0 2024-09-21T01:49:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f4900ff9640 1 -- 172.21.15.40:0/4293305126 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f48fc05f070 con 0x7f49040b7590 2024-09-21T01:49:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f51bcff9640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6826/2324338989,v1:172.21.15.139:6827/2324338989] conn(0x7f51a0081a50 0x7f51a0083f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f48fbfff640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6802/1976010004,v1:172.21.15.139:6803/1976010004] conn(0x7f48e4080ee0 0x7f48e4083330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.960+0000 7f51bcff9640 1 -- 172.21.15.40:0/2023076451 --> [v2:172.21.15.139:6826/2324338989,v1:172.21.15.139:6827/2324338989] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51a0084610 con 0x7f51a0081a50 2024-09-21T01:49:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.961+0000 7f49037fe640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f48e4078c90 0x7f48e407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.961+0000 7f3336ffd640 1 -- 172.21.15.40:0/3898621793 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f333c011920 con 0x7f332c0048a0 2024-09-21T01:49:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.961+0000 7f3336ffd640 1 -- 172.21.15.40:0/3898621793 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c011d70 con 0x7f332c0048a0 2024-09-21T01:49:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.961+0000 7f51bcff9640 1 -- 172.21.15.40:0/2023076451 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f51a8060b80 con 0x7f51c0202bb0 2024-09-21T01:49:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.961+0000 7f84b0904640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8490078c60 0x7f849007b170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84a4168440 tx=0x7f849c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.961+0000 7f51bf7fe640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6826/2324338989,v1:172.21.15.139:6827/2324338989] conn(0x7f51a0081a50 0x7f51a0083f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.961+0000 7f51beffd640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f51a0078be0 0x7f51a007b0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51b0001eb0 tx=0x7f51b00016e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.962+0000 7f49037fe640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f48e4078c90 0x7f48e407b1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48f4000c00 tx=0x7f48f400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.962+0000 7f51bf7fe640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6826/2324338989,v1:172.21.15.139:6827/2324338989] conn(0x7f51a0081a50 0x7f51a0083f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.962+0000 7f48fbfff640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6802/1976010004,v1:172.21.15.139:6803/1976010004] conn(0x7f48e4080ee0 0x7f48e4083330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.963+0000 7f4900ff9640 1 -- 172.21.15.40:0/4293305126 <== osd.6 v2:172.21.15.139:6802/1976010004 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48e4083a00 con 0x7f48e4080ee0 2024-09-21T01:49:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.964+0000 7f3336ffd640 1 -- 172.21.15.40:0/3898621793 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f333c018070 con 0x7f332c0048a0 2024-09-21T01:49:51.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.963+0000 7f51bcff9640 1 -- 172.21.15.40:0/2023076451 <== osd.7 v2:172.21.15.139:6826/2324338989 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f51a0084610 con 0x7f51a0081a50 2024-09-21T01:49:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.964+0000 7f3336ffd640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3324078b90 0x7f332407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.964+0000 7f3336ffd640 1 -- 172.21.15.40:0/3898621793 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f333c09bc10 con 0x7f332c0048a0 2024-09-21T01:49:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.965+0000 7f3336ffd640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6818/3013227265,v1:172.21.15.139:6819/3013227265] conn(0x7f3324080de0 0x7f3324083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.965+0000 7f3336ffd640 1 -- 172.21.15.40:0/3898621793 --> [v2:172.21.15.139:6818/3013227265,v1:172.21.15.139:6819/3013227265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3324083900 con 0x7f3324080de0 2024-09-21T01:49:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.965+0000 7f3336ffd640 1 -- 172.21.15.40:0/3898621793 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f333c09c000 con 0x7f332c0048a0 2024-09-21T01:49:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.965+0000 7f3345c51640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3324078b90 0x7f332407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.965+0000 7f3346c53640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6818/3013227265,v1:172.21.15.139:6819/3013227265] conn(0x7f3324080de0 0x7f3324083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.966+0000 7f3345c51640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3324078b90 0x7f332407b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3330034000 tx=0x7f33300012f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.966+0000 7f3346c53640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6818/3013227265,v1:172.21.15.139:6819/3013227265] conn(0x7f3324080de0 0x7f3324083230 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.967+0000 7f3336ffd640 1 -- 172.21.15.40:0/3898621793 <== osd.5 v2:172.21.15.139:6818/3013227265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3324083900 con 0x7f3324080de0 2024-09-21T01:49:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.981+0000 7f049ed9b640 1 -- 172.21.15.40:0/3294871767 --> [v2:172.21.15.40:6808/3415875567,v1:172.21.15.40:6809/3415875567] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f049809c450 con 0x7f0484080db0 2024-09-21T01:49:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.982+0000 7f04957fa640 1 -- 172.21.15.40:0/3294871767 <== osd.2 v2:172.21.15.40:6808/3415875567 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f049809c450 con 0x7f0484080db0 2024-09-21T01:49:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.983+0000 7f047effd640 1 -- 172.21.15.40:0/3294871767 >> [v2:172.21.15.40:6808/3415875567,v1:172.21.15.40:6809/3415875567] conn(0x7f0484080db0 msgr2=0x7f0484083200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.983+0000 7f047effd640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.40:6808/3415875567,v1:172.21.15.40:6809/3415875567] conn(0x7f0484080db0 0x7f0484083200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.983+0000 7f047effd640 1 -- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0484078bc0 msgr2=0x7f048407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.983+0000 7f047effd640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0484078bc0 0x7f048407b0d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0488000f60 tx=0x7f0488009040 comp rx=0 tx=0).stop 2024-09-21T01:49:51.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.984+0000 7f047effd640 1 -- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049816e820 msgr2=0x7f0498201f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.984+0000 7f047effd640 1 --2- 172.21.15.40:0/3294871767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049816e820 0x7f0498201f30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f049003a000 tx=0x7f04900045f0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.984+0000 7f049d338640 1 -- 172.21.15.40:0/3294871767 reap_dead start 2024-09-21T01:49:51.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.984+0000 7f047effd640 1 -- 172.21.15.40:0/3294871767 shutdown_connections 2024-09-21T01:49:51.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.984+0000 7f3b83cd5640 1 -- 172.21.15.40:0/3812447964 --> [v2:172.21.15.40:6824/238312773,v1:172.21.15.40:6825/238312773] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b64002d50 con 0x7f3b60080e50 2024-09-21T01:49:51.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.984+0000 7f047effd640 1 -- 172.21.15.40:0/3294871767 >> 172.21.15.40:0/3294871767 conn(0x7f049806d410 msgr2=0x7f04980b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.984+0000 7f047effd640 1 -- 172.21.15.40:0/3294871767 shutdown_connections 2024-09-21T01:49:51.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.984+0000 7f047effd640 1 -- 172.21.15.40:0/3294871767 wait complete. 2024-09-21T01:49:51.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.985+0000 7f3b727fc640 1 -- 172.21.15.40:0/3812447964 <== osd.0 v2:172.21.15.40:6824/238312773 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b64002d50 con 0x7f3b60080e50 2024-09-21T01:49:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.985+0000 7f3b5ffff640 1 -- 172.21.15.40:0/3812447964 >> [v2:172.21.15.40:6824/238312773,v1:172.21.15.40:6825/238312773] conn(0x7f3b60080e50 msgr2=0x7f3b600832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.985+0000 7f3b5ffff640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.40:6824/238312773,v1:172.21.15.40:6825/238312773] conn(0x7f3b60080e50 0x7f3b600832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.986+0000 7f3b5ffff640 1 -- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b60078be0 msgr2=0x7f3b6007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.986+0000 7f3b5ffff640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b60078be0 0x7f3b6007b0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b74035000 tx=0x7f3b7403a040 comp rx=0 tx=0).stop 2024-09-21T01:49:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.986+0000 7f3b5ffff640 1 -- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b7c0b3560 msgr2=0x7f3b7c0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.986+0000 7f3b5ffff640 1 --2- 172.21.15.40:0/3812447964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b7c0b3560 0x7f3b7c0700b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800e7c0 tx=0x7f3b7800ec80 comp rx=0 tx=0).stop 2024-09-21T01:49:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.986+0000 7f3b82272640 1 -- 172.21.15.40:0/3812447964 reap_dead start 2024-09-21T01:49:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.986+0000 7f3b5ffff640 1 -- 172.21.15.40:0/3812447964 shutdown_connections 2024-09-21T01:49:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.986+0000 7f3b5ffff640 1 -- 172.21.15.40:0/3812447964 >> 172.21.15.40:0/3812447964 conn(0x7f3b7c08bfc0 msgr2=0x7f3b7c0b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.986+0000 7f554d3dd640 1 -- 172.21.15.40:0/2852010547 --> [v2:172.21.15.40:6816/3104901496,v1:172.21.15.40:6817/3104901496] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f55480724c0 con 0x7f5534080d80 2024-09-21T01:49:51.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.987+0000 7f5544ff9640 1 -- 172.21.15.40:0/2852010547 <== osd.3 v2:172.21.15.40:6816/3104901496 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f55480724c0 con 0x7f5534080d80 2024-09-21T01:49:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.987+0000 7f3b5ffff640 1 -- 172.21.15.40:0/3812447964 shutdown_connections 2024-09-21T01:49:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.987+0000 7f3b5ffff640 1 -- 172.21.15.40:0/3812447964 wait complete. 2024-09-21T01:49:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.987+0000 7f552e7fc640 1 -- 172.21.15.40:0/2852010547 >> [v2:172.21.15.40:6816/3104901496,v1:172.21.15.40:6817/3104901496] conn(0x7f5534080d80 msgr2=0x7f55340831d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.987+0000 7f552e7fc640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.40:6816/3104901496,v1:172.21.15.40:6817/3104901496] conn(0x7f5534080d80 0x7f55340831d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.988+0000 7f8d8cb61640 1 -- 172.21.15.40:0/1651793473 --> [v2:172.21.15.139:6810/3827934146,v1:172.21.15.139:6811/3827934146] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8d68002dd0 con 0x7f8d6c080e30 2024-09-21T01:49:51.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.988+0000 7f552e7fc640 1 -- 172.21.15.40:0/2852010547 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5534078b90 msgr2=0x7f553407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.988+0000 7f552e7fc640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f5534078b90 0x7f553407b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55480cf500 tx=0x7f553c007860 comp rx=0 tx=0).stop 2024-09-21T01:49:51.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.988+0000 7f552e7fc640 1 -- 172.21.15.40:0/2852010547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554806e100 msgr2=0x7f554815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.988+0000 7f552e7fc640 1 --2- 172.21.15.40:0/2852010547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f554806e100 0x7f554815a4f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5538034040 tx=0x7f55380038a0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.988+0000 7f554cbdc640 1 -- 172.21.15.40:0/2852010547 reap_dead start 2024-09-21T01:49:51.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.988+0000 7f552e7fc640 1 -- 172.21.15.40:0/2852010547 shutdown_connections 2024-09-21T01:49:51.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.988+0000 7f552e7fc640 1 -- 172.21.15.40:0/2852010547 >> 172.21.15.40:0/2852010547 conn(0x7f55480b3c50 msgr2=0x7f55480af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.988+0000 7f8d73fff640 1 -- 172.21.15.40:0/1651793473 <== osd.4 v2:172.21.15.139:6810/3827934146 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8d68002dd0 con 0x7f8d6c080e30 2024-09-21T01:49:51.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f552e7fc640 1 -- 172.21.15.40:0/2852010547 shutdown_connections 2024-09-21T01:49:51.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f552e7fc640 1 -- 172.21.15.40:0/2852010547 wait complete. 2024-09-21T01:49:51.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f8d71ffb640 1 -- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6810/3827934146,v1:172.21.15.139:6811/3827934146] conn(0x7f8d6c080e30 msgr2=0x7f8d6c083280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f8d71ffb640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6810/3827934146,v1:172.21.15.139:6811/3827934146] conn(0x7f8d6c080e30 0x7f8d6c083280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f8d71ffb640 1 -- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8d6c078bc0 msgr2=0x7f8d6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f8d71ffb640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8d6c078bc0 0x7f8d6c07b0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c005f70 tx=0x7f8d7c00b260 comp rx=0 tx=0).stop 2024-09-21T01:49:51.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f8d71ffb640 1 -- 172.21.15.40:0/1651793473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d800e1100 msgr2=0x7f8d800d6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f8d71ffb640 1 --2- 172.21.15.40:0/1651793473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d800e1100 0x7f8d800d6e50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8d740036d0 tx=0x7f8d74003b90 comp rx=0 tx=0).stop 2024-09-21T01:49:51.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f8d87fff640 1 -- 172.21.15.40:0/1651793473 reap_dead start 2024-09-21T01:49:51.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f8d71ffb640 1 -- 172.21.15.40:0/1651793473 shutdown_connections 2024-09-21T01:49:51.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.989+0000 7f8d71ffb640 1 -- 172.21.15.40:0/1651793473 >> 172.21.15.40:0/1651793473 conn(0x7f8d800569f0 msgr2=0x7f8d8000d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.990+0000 7f848f7fe640 1 -- 172.21.15.40:0/2216010315 --> [v2:172.21.15.40:6800/2884298880,v1:172.21.15.40:6801/2884298880] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f84a4178a70 con 0x7f8490080f30 2024-09-21T01:49:51.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.990+0000 7f8d71ffb640 1 -- 172.21.15.40:0/1651793473 shutdown_connections 2024-09-21T01:49:51.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.990+0000 7f8d71ffb640 1 -- 172.21.15.40:0/1651793473 wait complete. 2024-09-21T01:49:51.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.990+0000 7f84a1ffb640 1 -- 172.21.15.40:0/2216010315 <== osd.1 v2:172.21.15.40:6800/2884298880 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f84a4178a70 con 0x7f8490080f30 2024-09-21T01:49:51.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.991+0000 7f848f7fe640 1 -- 172.21.15.40:0/2216010315 >> [v2:172.21.15.40:6800/2884298880,v1:172.21.15.40:6801/2884298880] conn(0x7f8490080f30 msgr2=0x7f8490083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.991+0000 7f848f7fe640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.40:6800/2884298880,v1:172.21.15.40:6801/2884298880] conn(0x7f8490080f30 0x7f8490083380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.992+0000 7f848f7fe640 1 -- 172.21.15.40:0/2216010315 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8490078c60 msgr2=0x7f849007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.992+0000 7f848f7fe640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8490078c60 0x7f849007b170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84a4168440 tx=0x7f849c009040 comp rx=0 tx=0).stop 2024-09-21T01:49:51.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.992+0000 7f848f7fe640 1 -- 172.21.15.40:0/2216010315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84a4006cc0 msgr2=0x7f84a40deca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.992+0000 7f848f7fe640 1 --2- 172.21.15.40:0/2216010315 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84a4006cc0 0x7f84a40deca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f84a8001530 tx=0x7f84a800c890 comp rx=0 tx=0).stop 2024-09-21T01:49:51.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.992+0000 7f84b1906640 1 -- 172.21.15.40:0/2216010315 reap_dead start 2024-09-21T01:49:51.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.992+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 --> [v2:172.21.15.139:6802/1976010004,v1:172.21.15.139:6803/1976010004] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49040c61e0 con 0x7f48e4080ee0 2024-09-21T01:49:51.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.993+0000 7f848f7fe640 1 -- 172.21.15.40:0/2216010315 shutdown_connections 2024-09-21T01:49:51.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.993+0000 7f848f7fe640 1 -- 172.21.15.40:0/2216010315 >> 172.21.15.40:0/2216010315 conn(0x7f84a4051420 msgr2=0x7f84a4004a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.993+0000 7f848f7fe640 1 -- 172.21.15.40:0/2216010315 shutdown_connections 2024-09-21T01:49:51.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.993+0000 7f848f7fe640 1 -- 172.21.15.40:0/2216010315 wait complete. 2024-09-21T01:49:51.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.993+0000 7f51b5ffb640 1 -- 172.21.15.40:0/2023076451 --> [v2:172.21.15.139:6826/2324338989,v1:172.21.15.139:6827/2324338989] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51c009acd0 con 0x7f51a0081a50 2024-09-21T01:49:51.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.993+0000 7f4900ff9640 1 -- 172.21.15.40:0/4293305126 <== osd.6 v2:172.21.15.139:6802/1976010004 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f49040c61e0 con 0x7f48e4080ee0 2024-09-21T01:49:51.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.994+0000 7f51bcff9640 1 -- 172.21.15.40:0/2023076451 <== osd.7 v2:172.21.15.139:6826/2324338989 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f51c009acd0 con 0x7f51a0081a50 2024-09-21T01:49:51.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.995+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6802/1976010004,v1:172.21.15.139:6803/1976010004] conn(0x7f48e4080ee0 msgr2=0x7f48e4083330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.995+0000 7f51b5ffb640 1 -- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6826/2324338989,v1:172.21.15.139:6827/2324338989] conn(0x7f51a0081a50 msgr2=0x7f51a0083f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.995+0000 7f51b5ffb640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6826/2324338989,v1:172.21.15.139:6827/2324338989] conn(0x7f51a0081a50 0x7f51a0083f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.995+0000 7f4908e5c640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6802/1976010004,v1:172.21.15.139:6803/1976010004] conn(0x7f48e4080ee0 0x7f48e4083330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.995+0000 7f51b5ffb640 1 -- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f51a0078be0 msgr2=0x7f51a007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.995+0000 7f51b5ffb640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f51a0078be0 0x7f51a007b0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51b0001eb0 tx=0x7f51b00016e0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.995+0000 7f51b5ffb640 1 -- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51c0202bb0 msgr2=0x7f51c00c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f51b5ffb640 1 --2- 172.21.15.40:0/2023076451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51c0202bb0 0x7f51c00c1a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f51a8011860 tx=0x7f51a8011d20 comp rx=0 tx=0).stop 2024-09-21T01:49:51.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f51bf7fe640 1 -- 172.21.15.40:0/2023076451 reap_dead start 2024-09-21T01:49:51.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f51b5ffb640 1 -- 172.21.15.40:0/2023076451 shutdown_connections 2024-09-21T01:49:51.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f51b5ffb640 1 -- 172.21.15.40:0/2023076451 >> 172.21.15.40:0/2023076451 conn(0x7f51c00b20a0 msgr2=0x7f51c00ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f48e4078c90 msgr2=0x7f48e407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f4908e5c640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f48e4078c90 0x7f48e407b1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f48f4000c00 tx=0x7f48f400b040 comp rx=0 tx=0).stop 2024-09-21T01:49:51.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040b7590 msgr2=0x7f4904152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f4908e5c640 1 --2- 172.21.15.40:0/4293305126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f49040b7590 0x7f4904152820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00be20 tx=0x7f48fc00bf10 comp rx=0 tx=0).stop 2024-09-21T01:49:51.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f4903fff640 1 -- 172.21.15.40:0/4293305126 reap_dead start 2024-09-21T01:49:51.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 shutdown_connections 2024-09-21T01:49:51.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 >> 172.21.15.40:0/4293305126 conn(0x7f49040b3c50 msgr2=0x7f49040b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f51b5ffb640 1 -- 172.21.15.40:0/2023076451 shutdown_connections 2024-09-21T01:49:51.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 shutdown_connections 2024-09-21T01:49:51.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.996+0000 7f4908e5c640 1 -- 172.21.15.40:0/4293305126 wait complete. 2024-09-21T01:49:51.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.997+0000 7f51b5ffb640 1 -- 172.21.15.40:0/2023076451 wait complete. 2024-09-21T01:49:51.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.997+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 --> [v2:172.21.15.139:6818/3013227265,v1:172.21.15.139:6819/3013227265] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3340154870 con 0x7f3324080de0 2024-09-21T01:49:51.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:50.998+0000 7f3336ffd640 1 -- 172.21.15.40:0/3898621793 <== osd.5 v2:172.21.15.139:6818/3013227265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3340154870 con 0x7f3324080de0 2024-09-21T01:49:51.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.000+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6818/3013227265,v1:172.21.15.139:6819/3013227265] conn(0x7f3324080de0 msgr2=0x7f3324083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.000+0000 7f3347454640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6818/3013227265,v1:172.21.15.139:6819/3013227265] conn(0x7f3324080de0 0x7f3324083230 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.000+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3324078b90 msgr2=0x7f332407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.000+0000 7f3347454640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3324078b90 0x7f332407b0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3330034000 tx=0x7f33300012f0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.000+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f332c0048a0 msgr2=0x7f33401468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.000+0000 7f3347454640 1 --2- 172.21.15.40:0/3898621793 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f332c0048a0 0x7f33401468b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f333c006de0 tx=0x7f333c0039c0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.001+0000 7f3346c53640 1 -- 172.21.15.40:0/3898621793 reap_dead start 2024-09-21T01:49:51.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.001+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 shutdown_connections 2024-09-21T01:49:51.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.001+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 >> 172.21.15.40:0/3898621793 conn(0x7f3340070b20 msgr2=0x7f33400ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.001+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 shutdown_connections 2024-09-21T01:49:51.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.001+0000 7f3347454640 1 -- 172.21.15.40:0/3898621793 wait complete. 2024-09-21T01:49:51.025 INFO:teuthology.orchestra.run.smithi040.stdout:60129542153 2024-09-21T01:49:51.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T01:49:51.027 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-09-21T01:49:51.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T01:49:51.027 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-21T01:49:51.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T01:49:51.028 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-09-21T01:49:51.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T01:49:51.029 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-09-21T01:49:51.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T01:49:51.030 INFO:teuthology.orchestra.run.smithi040.stdout:64424509449 2024-09-21T01:49:51.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T01:49:51.031 INFO:teuthology.orchestra.run.smithi040.stdout:60129542152 2024-09-21T01:49:51.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T01:49:51.032 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-21T01:49:51.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T01:49:51.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.295+0000 7f4b12ffd640 1 -- 172.21.15.40:0/2369327073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800a330 con 0x7f4b1408b140 2024-09-21T01:49:51.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.295+0000 7f4b1a901640 1 -- 172.21.15.40:0/2369327073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1408b140 msgr2=0x7f4b140cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.295+0000 7f4b1a901640 1 --2- 172.21.15.40:0/2369327073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1408b140 0x7f4b140cf6d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b08008640 tx=0x7f4b0802c670 comp rx=0 tx=0).stop 2024-09-21T01:49:51.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.295+0000 7f4b1a901640 1 -- 172.21.15.40:0/2369327073 shutdown_connections 2024-09-21T01:49:51.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.295+0000 7f4b1a901640 1 --2- 172.21.15.40:0/2369327073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b1408b140 0x7f4b140cf6d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.295+0000 7f4b1a901640 1 -- 172.21.15.40:0/2369327073 >> 172.21.15.40:0/2369327073 conn(0x7f4b140b20a0 msgr2=0x7f4b140b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.296+0000 7f4b1a901640 1 -- 172.21.15.40:0/2369327073 shutdown_connections 2024-09-21T01:49:51.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.297+0000 7fe5fb14e640 1 -- 172.21.15.40:0/4083512222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f40b3230 msgr2=0x7fe5f40d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.297+0000 7fe5fb14e640 1 --2- 172.21.15.40:0/4083512222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f40b3230 0x7fe5f40d0340 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe5f415f3b0 tx=0x7fe5ec02a8e0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.296+0000 7f4b1a901640 1 -- 172.21.15.40:0/2369327073 wait complete. 2024-09-21T01:49:51.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.298+0000 7fe5fb14e640 1 -- 172.21.15.40:0/4083512222 shutdown_connections 2024-09-21T01:49:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.298+0000 7fe5fb14e640 1 --2- 172.21.15.40:0/4083512222 >> v2:172.21.15.40:3300/0 conn(0x7fe5f40b3640 0x7fe5f40d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.298+0000 7fe5fb14e640 1 --2- 172.21.15.40:0/4083512222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f40b3230 0x7fe5f40d0340 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.298+0000 7fe5fb14e640 1 -- 172.21.15.40:0/4083512222 >> 172.21.15.40:0/4083512222 conn(0x7fe5f4070b20 msgr2=0x7fe5f4070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.298+0000 7fe5fb14e640 1 -- 172.21.15.40:0/4083512222 shutdown_connections 2024-09-21T01:49:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.298+0000 7fe5fb14e640 1 -- 172.21.15.40:0/4083512222 wait complete. 2024-09-21T01:49:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.299+0000 7f4b1a901640 1 Processor -- start 2024-09-21T01:49:51.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.299+0000 7f4b1a901640 1 -- start start 2024-09-21T01:49:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.300+0000 7f9f9db50640 1 -- 172.21.15.40:0/1193692600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f98155c70 msgr2=0x7f9f98073e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.300+0000 7f9f9db50640 1 --2- 172.21.15.40:0/1193692600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f98155c70 0x7f9f98073e50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009830 tx=0x7f9f8c02a480 comp rx=0 tx=0).stop 2024-09-21T01:49:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f9f9db50640 1 -- 172.21.15.40:0/1193692600 shutdown_connections 2024-09-21T01:49:51.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f9f9db50640 1 --2- 172.21.15.40:0/1193692600 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f98155c70 0x7f9f98073e50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f9f9db50640 1 --2- 172.21.15.40:0/1193692600 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9f98071330 0x7f9f9815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f9f9db50640 1 -- 172.21.15.40:0/1193692600 >> 172.21.15.40:0/1193692600 conn(0x7f9f980b2e10 msgr2=0x7f9f980b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f9f9db50640 1 -- 172.21.15.40:0/1193692600 shutdown_connections 2024-09-21T01:49:51.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f9f9db50640 1 -- 172.21.15.40:0/1193692600 wait complete. 2024-09-21T01:49:51.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1026590550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dd815f030 msgr2=0x7f3dd80af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f3ddf64d640 1 --2- 172.21.15.40:0/1026590550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dd815f030 0x7f3dd80af500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800a940 tx=0x7f3dc802b850 comp rx=0 tx=0).stop 2024-09-21T01:49:51.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7fe5fb14e640 1 Processor -- start 2024-09-21T01:49:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1026590550 shutdown_connections 2024-09-21T01:49:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f3ddf64d640 1 --2- 172.21.15.40:0/1026590550 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3dd80afa40 0x7f3dd8070730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f3ddf64d640 1 --2- 172.21.15.40:0/1026590550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dd815f030 0x7f3dd80af500 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7fe5fb14e640 1 -- start start 2024-09-21T01:49:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.301+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1026590550 >> 172.21.15.40:0/1026590550 conn(0x7f3dd80cd4b0 msgr2=0x7f3dd80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.302+0000 7f4b1a901640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b1408b140 0x7f4b1408a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.302+0000 7f4b1a901640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b1408b690 0x7f4b142028a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.302+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1026590550 shutdown_connections 2024-09-21T01:49:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.302+0000 7f4b13fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b1408b140 0x7f4b1408a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.302+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1026590550 wait complete. 2024-09-21T01:49:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.302+0000 7f8dcf194640 1 -- 172.21.15.40:0/1477762580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc80ccde0 msgr2=0x7f8dc80cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.302+0000 7f8dcf194640 1 --2- 172.21.15.40:0/1477762580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc80ccde0 0x7f8dc80cd1f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8071d60 tx=0x7f8dc002a9a0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.302+0000 7f4b13fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b1408b140 0x7f4b1408a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:33412/0 (socket says 172.21.15.40:33412) 2024-09-21T01:49:51.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.302+0000 7f4b13fff640 1 -- 172.21.15.40:0/242158944 learned_addr learned my addr 172.21.15.40:0/242158944 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:51.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f4b137fe640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b1408b690 0x7f4b142028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f8dcf194640 1 -- 172.21.15.40:0/1477762580 shutdown_connections 2024-09-21T01:49:51.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f8dcf194640 1 --2- 172.21.15.40:0/1477762580 >> v2:172.21.15.40:3300/0 conn(0x7f8dc81624d0 0x7f8dc81628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f8dcf194640 1 --2- 172.21.15.40:0/1477762580 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc80ccde0 0x7f8dc80cd1f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f8dcf194640 1 --2- 172.21.15.40:0/1477762580 >> v2:172.21.15.139:3300/0 conn(0x7f8dc815f9a0 0x7f8dc80af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f8dcf194640 1 -- 172.21.15.40:0/1477762580 >> 172.21.15.40:0/1477762580 conn(0x7f8dc80b20a0 msgr2=0x7f8dc80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f4b1a901640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b140cfc10 0x7f4b140ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f8dcf194640 1 -- 172.21.15.40:0/1477762580 shutdown_connections 2024-09-21T01:49:51.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f8dcf194640 1 -- 172.21.15.40:0/1477762580 wait complete. 2024-09-21T01:49:51.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f4b18e9e640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b140cfc10 0x7f4b140ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4b140cd670 con 0x7f4b140cfc10 2024-09-21T01:49:51.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7fe35c68c640 1 -- 172.21.15.40:0/3706528133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe35415bb20 msgr2=0x7fe354073260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7fe35c68c640 1 --2- 172.21.15.40:0/3706528133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe35415bb20 0x7fe354073260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe354074490 tx=0x7fe35002a560 comp rx=0 tx=0).stop 2024-09-21T01:49:51.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4b140cd4f0 con 0x7f4b1408b690 2024-09-21T01:49:51.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f4b140cb180 con 0x7f4b1408b140 2024-09-21T01:49:51.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7fe35c68c640 1 -- 172.21.15.40:0/3706528133 shutdown_connections 2024-09-21T01:49:51.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7fe35c68c640 1 --2- 172.21.15.40:0/3706528133 >> v2:172.21.15.40:3300/0 conn(0x7fe354069c30 0x7fe354154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7fe35c68c640 1 --2- 172.21.15.40:0/3706528133 >> v2:172.21.15.139:3300/0 conn(0x7fe3540ce930 0x7fe3540ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7fe35c68c640 1 --2- 172.21.15.40:0/3706528133 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe35415bb20 0x7fe354073260 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7fe35c68c640 1 -- 172.21.15.40:0/3706528133 >> 172.21.15.40:0/3706528133 conn(0x7fe3540b21d0 msgr2=0x7fe3540b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.303+0000 7fe35c68c640 1 -- 172.21.15.40:0/3706528133 shutdown_connections 2024-09-21T01:49:51.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7fe35c68c640 1 -- 172.21.15.40:0/3706528133 wait complete. 2024-09-21T01:49:51.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7f9f9db50640 1 Processor -- start 2024-09-21T01:49:51.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7f4b18e9e640 1 -- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b1408b140 msgr2=0x7f4b1408a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7f4b18e9e640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b1408b140 0x7f4b1408a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7fe5fb14e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f40b3230 0x7fe5f4141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7f9f9db50640 1 -- start start 2024-09-21T01:49:51.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7f4b18e9e640 1 -- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b1408b690 msgr2=0x7f4b142028a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7fe5fb14e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5f40b3640 0x7fe5f4143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7f4b18e9e640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b1408b690 0x7f4b142028a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7f4b18e9e640 1 -- 172.21.15.40:0/242158944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1408ac10 con 0x7f4b140cfc10 2024-09-21T01:49:51.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.304+0000 7f4b13fff640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b1408b140 0x7f4b1408a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:51.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fb14e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5f4162d00 0x7fe5f4143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5f994b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5f40b3640 0x7fe5f4143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fb14e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f40aeaf0 con 0x7fe5f40b3640 2024-09-21T01:49:51.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fb14e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f40ae970 con 0x7fe5f40b3230 2024-09-21T01:49:51.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5f994b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5f40b3640 0x7fe5f4143a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33394/0 (socket says 172.21.15.40:33394) 2024-09-21T01:49:51.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fb14e640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f40aec70 con 0x7fe5f4162d00 2024-09-21T01:49:51.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5f994b640 1 -- 172.21.15.40:0/2840476022 learned_addr learned my addr 172.21.15.40:0/2840476022 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:51.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fa14c640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f40b3230 0x7fe5f4141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7f4b18e9e640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b140cfc10 0x7f4b140ae540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00cac0 tx=0x7f4b0c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7f47577fe640 1 -- 172.21.15.40:0/3565722138 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4750032ad0 con 0x7f47580cceb0 2024-09-21T01:49:51.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fa94d640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5f4162d00 0x7fe5f4143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7f475ec64640 1 -- 172.21.15.40:0/3565722138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47580cceb0 msgr2=0x7f475806ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7f475ec64640 1 --2- 172.21.15.40:0/3565722138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47580cceb0 0x7f475806ee90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4758075050 tx=0x7f4750009260 comp rx=0 tx=0).stop 2024-09-21T01:49:51.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f4b10ff9640 1 -- 172.21.15.40:0/242158944 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c017070 con 0x7f4b140cfc10 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fa94d640 1 -- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f40b3230 msgr2=0x7fe5f4141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fa94d640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f40b3230 0x7fe5f4141070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fa94d640 1 -- 172.21.15.40:0/2840476022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5f40b3640 msgr2=0x7fe5f4143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fa94d640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5f40b3640 0x7fe5f4143a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.305+0000 7fe5fa94d640 1 -- 172.21.15.40:0/2840476022 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f415aa40 con 0x7fe5f4162d00 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f475ec64640 1 -- 172.21.15.40:0/3565722138 shutdown_connections 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f475ec64640 1 --2- 172.21.15.40:0/3565722138 >> v2:172.21.15.40:3300/0 conn(0x7f475815ef10 0x7f47580cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f475ec64640 1 --2- 172.21.15.40:0/3565722138 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47580cceb0 0x7f475806ee90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f475ec64640 1 --2- 172.21.15.40:0/3565722138 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f475815a9b0 0x7f47580cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f475ec64640 1 -- 172.21.15.40:0/3565722138 >> 172.21.15.40:0/3565722138 conn(0x7f475806d7d0 msgr2=0x7f47580b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f8dcf194640 1 Processor -- start 2024-09-21T01:49:51.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b142033b0 con 0x7f4b140cfc10 2024-09-21T01:49:51.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f475ec64640 1 -- 172.21.15.40:0/3565722138 shutdown_connections 2024-09-21T01:49:51.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f8dcf194640 1 -- start start 2024-09-21T01:49:51.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f475ec64640 1 -- 172.21.15.40:0/3565722138 wait complete. 2024-09-21T01:49:51.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f3ddf64d640 1 Processor -- start 2024-09-21T01:49:51.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f4b10ff9640 1 -- 172.21.15.40:0/242158944 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b0c003c60 con 0x7f4b140cfc10 2024-09-21T01:49:51.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f3ddf64d640 1 -- start start 2024-09-21T01:49:51.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f71ab3ba640 1 -- 172.21.15.40:0/2779655820 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a40d2a00 msgr2=0x7f71a415a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f9db50640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9f98071330 0x7f9f980cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.306+0000 7f71ab3ba640 1 --2- 172.21.15.40:0/2779655820 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a40d2a00 0x7f71a415a570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f719c009ca0 tx=0x7f719c02a9e0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b140c5d80 con 0x7f4b140cfc10 2024-09-21T01:49:51.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f9db50640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f98074390 0x7f9f98145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f71ab3ba640 1 -- 172.21.15.40:0/2779655820 shutdown_connections 2024-09-21T01:49:51.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f977fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9f98071330 0x7f9f980cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f977fe640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9f98071330 0x7f9f980cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:33444/0 (socket says 172.21.15.40:33444) 2024-09-21T01:49:51.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f9db50640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f98155c70 0x7f9f980b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f71ab3ba640 1 --2- 172.21.15.40:0/2779655820 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a40d2a00 0x7f71a415a570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f71ab3ba640 1 -- 172.21.15.40:0/2779655820 >> 172.21.15.40:0/2779655820 conn(0x7f71a4072ae0 msgr2=0x7f71a4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f977fe640 1 -- 172.21.15.40:0/3468707357 learned_addr learned my addr 172.21.15.40:0/3468707357 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:51.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7fe35c68c640 1 Processor -- start 2024-09-21T01:49:51.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f9db50640 1 -- 172.21.15.40:0/3468707357 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9815f9d0 con 0x7f9f98155c70 2024-09-21T01:49:51.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f9db50640 1 -- 172.21.15.40:0/3468707357 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9f980d0990 con 0x7f9f98074390 2024-09-21T01:49:51.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f9db50640 1 -- 172.21.15.40:0/3468707357 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f9f9815fb50 con 0x7f9f98071330 2024-09-21T01:49:51.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7fe35c68c640 1 -- start start 2024-09-21T01:49:51.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f97fff640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f98155c70 0x7f9f980b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f4b10ff9640 1 -- 172.21.15.40:0/242158944 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00a940 con 0x7f4b140cfc10 2024-09-21T01:49:51.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f9f96ffd640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f98074390 0x7f9f98145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.307+0000 7f71ab3ba640 1 -- 172.21.15.40:0/2779655820 shutdown_connections 2024-09-21T01:49:51.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f977fe640 1 -- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f98074390 msgr2=0x7f9f98145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f977fe640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f98074390 0x7f9f98145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f977fe640 1 -- 172.21.15.40:0/3468707357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f98155c70 msgr2=0x7f9f980b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f977fe640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f98155c70 0x7f9f980b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f977fe640 1 -- 172.21.15.40:0/3468707357 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f981f9390 con 0x7f9f98071330 2024-09-21T01:49:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f977fe640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9f98071330 0x7f9f980cb800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c9a0 tx=0x7f9f8800ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f7ffff640 1 -- 172.21.15.40:0/3468707357 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88007bb0 con 0x7f9f98071330 2024-09-21T01:49:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f7ffff640 1 -- 172.21.15.40:0/3468707357 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f88007e40 con 0x7f9f98071330 2024-09-21T01:49:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f9db50640 1 -- 172.21.15.40:0/3468707357 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f981f9670 con 0x7f9f98071330 2024-09-21T01:49:51.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af4005290 con 0x7f4b140cfc10 2024-09-21T01:49:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7fe5fa94d640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5f4162d00 0x7fe5f4143f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000b390 tx=0x7fe5f000b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f8dcf194640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc80ccde0 0x7f8dc8074a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dcf194640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc815f9a0 0x7f8dc80ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dcf194640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc81624d0 0x7f8dc80ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dc7fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc815f9a0 0x7f8dc80ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dccf30640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc80ccde0 0x7f8dc8074a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dc7fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc815f9a0 0x7f8dc80ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:33446/0 (socket says 172.21.15.40:33446) 2024-09-21T01:49:51.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f3ddf64d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dd80afa40 0x7f3dd8154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dccf30640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc80ccde0 0x7f8dc8074a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33412/0 (socket says 172.21.15.40:33412) 2024-09-21T01:49:51.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dc7fff640 1 -- 172.21.15.40:0/3086449613 learned_addr learned my addr 172.21.15.40:0/3086449613 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:51.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f3ddf64d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3dd80cec40 0x7f3dd8158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dcd731640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc81624d0 0x7f8dc80ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f3ddf64d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3dd815f030 0x7f3dd815d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7fe5eaffd640 1 -- 172.21.15.40:0/2840476022 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0015020 con 0x7fe5f4162d00 2024-09-21T01:49:51.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f3ddf64d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8076100 con 0x7f3dd80afa40 2024-09-21T01:49:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7fe5eaffd640 1 -- 172.21.15.40:0/2840476022 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5f0011940 con 0x7fe5f4162d00 2024-09-21T01:49:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc815bf10 con 0x7f8dc80ccde0 2024-09-21T01:49:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc815bd90 con 0x7f8dc81624d0 2024-09-21T01:49:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7fe5fb14e640 1 -- 172.21.15.40:0/2840476022 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f4144670 con 0x7fe5f4162d00 2024-09-21T01:49:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc815c090 con 0x7f8dc815f9a0 2024-09-21T01:49:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f71ab3ba640 1 -- 172.21.15.40:0/2779655820 wait complete. 2024-09-21T01:49:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.308+0000 7f9f9db50640 1 -- 172.21.15.40:0/3468707357 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f981f9c30 con 0x7f9f98071330 2024-09-21T01:49:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.309+0000 7f9f7ffff640 1 -- 172.21.15.40:0/3468707357 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f88005260 con 0x7f9f98071330 2024-09-21T01:49:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f9f9db50640 1 -- 172.21.15.40:0/3468707357 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f98155860 con 0x7f9f98071330 2024-09-21T01:49:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f9f7ffff640 1 -- 172.21.15.40:0/3468707357 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f88005400 con 0x7f9f98071330 2024-09-21T01:49:51.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7fe5fb14e640 1 -- 172.21.15.40:0/2840476022 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f41415b0 con 0x7fe5f4162d00 2024-09-21T01:49:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f475ec64640 1 Processor -- start 2024-09-21T01:49:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f475ec64640 1 -- start start 2024-09-21T01:49:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f8dc7fff640 1 -- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc81624d0 msgr2=0x7f8dc80ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f8dc7fff640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc81624d0 0x7f8dc80ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f8dc7fff640 1 -- 172.21.15.40:0/3086449613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc80ccde0 msgr2=0x7f8dc8074a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f8dc7fff640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc80ccde0 0x7f8dc8074a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f8dc7fff640 1 -- 172.21.15.40:0/3086449613 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc8073e70 con 0x7f8dc815f9a0 2024-09-21T01:49:51.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f8dccf30640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc80ccde0 0x7f8dc8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f3ddcbe8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3dd80cec40 0x7f3dd8158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f3ddcbe8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3dd80cec40 0x7f3dd8158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:33460/0 (socket says 172.21.15.40:33460) 2024-09-21T01:49:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f3ddcbe8640 1 -- 172.21.15.40:0/1635296853 learned_addr learned my addr 172.21.15.40:0/1635296853 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f3dddbea640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3dd815f030 0x7f3dd815d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8075f80 con 0x7f3dd815f030 2024-09-21T01:49:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.310+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd8076280 con 0x7f3dd80cec40 2024-09-21T01:49:51.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f4b10ff9640 1 -- 172.21.15.40:0/242158944 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b0c01a070 con 0x7f4b140cfc10 2024-09-21T01:49:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f8dcd731640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc81624d0 0x7f8dc80ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f3ddd3e9640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dd80afa40 0x7f3dd8154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f3dddbea640 1 -- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3dd80cec40 msgr2=0x7f3dd8158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f3dddbea640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3dd80cec40 0x7f3dd8158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f3dddbea640 1 -- 172.21.15.40:0/1635296853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dd80afa40 msgr2=0x7f3dd8154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f3dddbea640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dd80afa40 0x7f3dd8154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f3dddbea640 1 -- 172.21.15.40:0/1635296853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd81fa0a0 con 0x7f3dd815f030 2024-09-21T01:49:51.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f3ddd3e9640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dd80afa40 0x7f3dd8154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:51.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f71ab3ba640 1 Processor -- start 2024-09-21T01:49:51.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f71ab3ba640 1 -- start start 2024-09-21T01:49:51.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7f8dc7fff640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc815f9a0 0x7f8dc80ae250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8db400d770 tx=0x7f8db400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f9f7ffff640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9f84078c10 0x7f9f8407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f8dc57fa640 1 -- 172.21.15.40:0/3086449613 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4017070 con 0x7f8dc815f9a0 2024-09-21T01:49:51.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7fe35c68c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe354069c30 0x7fe3541554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7fe35c68c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3540ce930 0x7fe3540b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7fe35c68c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe35415bb20 0x7fe3540b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7fe35c68c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540cbc20 con 0x7fe3540ce930 2024-09-21T01:49:51.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7fe35c68c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540cbaa0 con 0x7fe35415bb20 2024-09-21T01:49:51.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7fe35c68c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fe3540cbda0 con 0x7fe354069c30 2024-09-21T01:49:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc81f9de0 con 0x7f8dc815f9a0 2024-09-21T01:49:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc81fa3a0 con 0x7f8dc815f9a0 2024-09-21T01:49:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7fe35a428640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe354069c30 0x7fe3541554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7fe35a428640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe354069c30 0x7fe3541554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3301/0 says I am v2:172.21.15.40:33464/0 (socket says 172.21.15.40:33464) 2024-09-21T01:49:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7fe35a428640 1 -- 172.21.15.40:0/1870850635 learned_addr learned my addr 172.21.15.40:0/1870850635 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f4b10ff9640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4b00078c90 0x7f4b0007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f4b13fff640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4b00078c90 0x7f4b0007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f4b10ff9640 1 -- 172.21.15.40:0/242158944 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4b0c09a0f0 con 0x7f4b140cfc10 2024-09-21T01:49:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.313+0000 7f4b13fff640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4b00078c90 0x7f4b0007b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b08008590 tx=0x7f4b08004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f9f7ffff640 1 -- 172.21.15.40:0/3468707357 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f8809b0e0 con 0x7f9f98071330 2024-09-21T01:49:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.311+0000 7fe5eaffd640 1 -- 172.21.15.40:0/2840476022 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f0011d90 con 0x7fe5f4162d00 2024-09-21T01:49:51.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f475ec64640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47580cceb0 0x7f475809bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f8dc57fa640 1 -- 172.21.15.40:0/3086449613 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8db4009d20 con 0x7f8dc815f9a0 2024-09-21T01:49:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f3dddbea640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3dd815f030 0x7f3dd815d6c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000e960 tx=0x7f3dd000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f3dcdffb640 1 -- 172.21.15.40:0/1635296853 <== mon.1 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0004d20 con 0x7f3dd815f030 2024-09-21T01:49:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7f3dcdffb640 1 -- 172.21.15.40:0/1635296853 <== mon.1 v2:172.21.15.139:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dd000ca60 con 0x7f3dd815f030 2024-09-21T01:49:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7fe35a428640 1 -- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe35415bb20 msgr2=0x7fe3540b5860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T01:49:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7fe35a428640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe35415bb20 0x7fe3540b5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7fe35a428640 1 -- 172.21.15.40:0/1870850635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3540ce930 msgr2=0x7fe3540b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7fe35a428640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3540ce930 0x7fe3540b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.312+0000 7fe35a428640 1 -- 172.21.15.40:0/1870850635 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe354158000 con 0x7fe354069c30 2024-09-21T01:49:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.313+0000 7f3dcdffb640 1 -- 172.21.15.40:0/1635296853 <== mon.1 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0005020 con 0x7f3dd815f030 2024-09-21T01:49:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.313+0000 7fe35a428640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe354069c30 0x7fe3541554c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe350034040 tx=0x7fe350003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.313+0000 7f9f96ffd640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9f84078c10 0x7f9f8407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.313+0000 7fe5e8ff9640 1 -- 172.21.15.40:0/2840476022 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f41448b0 con 0x7fe5f4162d00 2024-09-21T01:49:51.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.313+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd81fa380 con 0x7f3dd815f030 2024-09-21T01:49:51.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71ab3ba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a40d04c0 0x7f71a406f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71ab3ba640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a40d08d0 0x7f71a4159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd81fa940 con 0x7f3dd815f030 2024-09-21T01:49:51.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71ab3ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40d2a00 0x7f71a4201760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.313+0000 7f8dc57fa640 1 -- 172.21.15.40:0/3086449613 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db40106c0 con 0x7f8dc815f9a0 2024-09-21T01:49:51.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f9f96ffd640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9f84078c10 0x7f9f8407b120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c034000 tx=0x7f9f8c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71ab3ba640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f71a415d140 con 0x7f71a40d04c0 2024-09-21T01:49:51.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7fe5eaffd640 1 -- 172.21.15.40:0/2840476022 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5f0018020 con 0x7fe5f4162d00 2024-09-21T01:49:51.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f475ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47580cceb0 0x7f475809bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da8005290 con 0x7f8dc815f9a0 2024-09-21T01:49:51.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71ab3ba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f71a40cfc40 con 0x7f71a40d2a00 2024-09-21T01:49:51.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f475ec64640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f475815a9b0 0x7f475814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71ab3ba640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f71a415d2c0 con 0x7f71a40d08d0 2024-09-21T01:49:51.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71a9156640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a40d04c0 0x7f71a406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71a9156640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a40d04c0 0x7f71a406f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33456/0 (socket says 172.21.15.40:33456) 2024-09-21T01:49:51.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71a9156640 1 -- 172.21.15.40:0/400611695 learned_addr learned my addr 172.21.15.40:0/400611695 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:51.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f475ca00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47580cceb0 0x7f475809bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33440/0 (socket says 172.21.15.40:33440) 2024-09-21T01:49:51.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71a8955640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a40d08d0 0x7f71a4159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f71a9957640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40d2a00 0x7f71a4201760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f475ec64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f475815ef10 0x7f47580ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f4757fff640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f475815a9b0 0x7f475814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.314+0000 7f475ca00640 1 -- 172.21.15.40:0/3071421501 learned_addr learned my addr 172.21.15.40:0/3071421501 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f475ec64640 1 -- 172.21.15.40:0/3071421501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f47580cc760 con 0x7f47580cceb0 2024-09-21T01:49:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f475ec64640 1 -- 172.21.15.40:0/3071421501 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f47580cc5e0 con 0x7f475815ef10 2024-09-21T01:49:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f71a8955640 1 -- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40d2a00 msgr2=0x7f71a4201760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f71a8955640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40d2a00 0x7f71a4201760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f71a8955640 1 -- 172.21.15.40:0/400611695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a40d04c0 msgr2=0x7f71a406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f71a8955640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a40d04c0 0x7f71a406f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f475ec64640 1 -- 172.21.15.40:0/3071421501 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f4758070f20 con 0x7f475815a9b0 2024-09-21T01:49:51.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f71a8955640 1 -- 172.21.15.40:0/400611695 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a4154060 con 0x7f71a40d08d0 2024-09-21T01:49:51.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f71a9156640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a40d04c0 0x7f71a406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:49:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7fe5eaffd640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe5d8078c90 0x7fe5d807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7fe5eaffd640 1 -- 172.21.15.40:0/2840476022 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe5f009abf0 con 0x7fe5f4162d00 2024-09-21T01:49:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f475d201640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f475815ef10 0x7f47580ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7fe5fa14c640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe5d8078c90 0x7fe5d807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f71a8955640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a40d08d0 0x7f71a4159290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f719400c310 tx=0x7f719400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd8070730 con 0x7f3dd815f030 2024-09-21T01:49:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f475ca00640 1 -- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f475815a9b0 msgr2=0x7f475814dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f475ca00640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f475815a9b0 0x7f475814dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f475ca00640 1 -- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f475815ef10 msgr2=0x7f47580ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f475ca00640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f475815ef10 0x7f47580ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.315+0000 7f475ca00640 1 -- 172.21.15.40:0/3071421501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475809c520 con 0x7f47580cceb0 2024-09-21T01:49:51.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.316+0000 7fe5fa14c640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe5d8078c90 0x7fe5d807b1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4001720 tx=0x7fe5e4007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.316+0000 7f475ca00640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47580cceb0 0x7f475809bbb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f474c0078a0 tx=0x7f474c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.316+0000 7f3dcdffb640 1 -- 172.21.15.40:0/1635296853 <== mon.1 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3dd00051c0 con 0x7f3dd815f030 2024-09-21T01:49:51.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.316+0000 7f3dcdffb640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3dbc078be0 0x7f3dbc07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.317+0000 7f3dcdffb640 1 -- 172.21.15.40:0/1635296853 <== mon.1 v2:172.21.15.139:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3dd009b480 con 0x7f3dd815f030 2024-09-21T01:49:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.317+0000 7f3ddd3e9640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3dbc078be0 0x7f3dbc07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.317+0000 7f3ddd3e9640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3dbc078be0 0x7f3dbc07b0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4001220 tx=0x7f3dd4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.318+0000 7f9f7ffff640 1 -- 172.21.15.40:0/3468707357 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9f98155860 con 0x7f9f98071330 2024-09-21T01:49:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.318+0000 7fe34affd640 1 -- 172.21.15.40:0/1870850635 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35003e030 con 0x7fe354069c30 2024-09-21T01:49:51.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.318+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3540b4840 con 0x7fe354069c30 2024-09-21T01:49:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.318+0000 7f7199ffb640 1 -- 172.21.15.40:0/400611695 <== mon.2 v2:172.21.15.139:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194017070 con 0x7f71a40d08d0 2024-09-21T01:49:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.319+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3540b4e00 con 0x7fe354069c30 2024-09-21T01:49:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.319+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a406fbe0 con 0x7f71a40d08d0 2024-09-21T01:49:51.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.319+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a4205ea0 con 0x7f71a40d08d0 2024-09-21T01:49:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.319+0000 7f47557fa640 1 -- 172.21.15.40:0/3071421501 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c00e980 con 0x7f47580cceb0 2024-09-21T01:49:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.320+0000 7f47557fa640 1 -- 172.21.15.40:0/3071421501 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f474c00ec10 con 0x7f47580cceb0 2024-09-21T01:49:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.320+0000 7f4b10ff9640 1 -- 172.21.15.40:0/242158944 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4b0c061fe0 con 0x7f4b140cfc10 2024-09-21T01:49:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.320+0000 7f8dc57fa640 1 -- 172.21.15.40:0/3086449613 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8db401a070 con 0x7f8dc815f9a0 2024-09-21T01:49:51.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.320+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3540ced40 con 0x7fe354069c30 2024-09-21T01:49:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.320+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a40d22f0 con 0x7f71a40d08d0 2024-09-21T01:49:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.321+0000 7f47557fa640 1 -- 172.21.15.40:0/3071421501 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c005020 con 0x7f47580cceb0 2024-09-21T01:49:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.321+0000 7f475ec64640 1 -- 172.21.15.40:0/3071421501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475809c800 con 0x7f47580cceb0 2024-09-21T01:49:51.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.321+0000 7f475ec64640 1 -- 172.21.15.40:0/3071421501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475815b060 con 0x7f47580cceb0 2024-09-21T01:49:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.321+0000 7f8dc57fa640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8dac078be0 0x7f8dac07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.322+0000 7f475ec64640 1 -- 172.21.15.40:0/3071421501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47580cfae0 con 0x7f47580cceb0 2024-09-21T01:49:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.322+0000 7f8dccf30640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8dac078be0 0x7f8dac07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.322+0000 7f3dcdffb640 1 -- 172.21.15.40:0/1635296853 <== mon.1 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3dd0016030 con 0x7f3dd815f030 2024-09-21T01:49:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.323+0000 7f47557fa640 1 -- 172.21.15.40:0/3071421501 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f474c01b020 con 0x7f47580cceb0 2024-09-21T01:49:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.323+0000 7f8dccf30640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8dac078be0 0x7f8dac07b0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009a30 tx=0x7f8dbc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.323+0000 7f47557fa640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f473c078bc0 0x7f473c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.324+0000 7f47557fa640 1 -- 172.21.15.40:0/3071421501 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f474c09add0 con 0x7f47580cceb0 2024-09-21T01:49:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.324+0000 7f8dc57fa640 1 -- 172.21.15.40:0/3086449613 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8db405f350 con 0x7f8dc815f9a0 2024-09-21T01:49:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.324+0000 7fe34affd640 1 -- 172.21.15.40:0/1870850635 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe350005310 con 0x7fe354069c30 2024-09-21T01:49:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.324+0000 7f4757fff640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f473c078bc0 0x7f473c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.324+0000 7fe34affd640 1 -- 172.21.15.40:0/1870850635 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350048060 con 0x7fe354069c30 2024-09-21T01:49:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.324+0000 7fe5eaffd640 1 -- 172.21.15.40:0/2840476022 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe5f001f020 con 0x7fe5f4162d00 2024-09-21T01:49:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.324+0000 7f7199ffb640 1 -- 172.21.15.40:0/400611695 <== mon.2 v2:172.21.15.139:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71940052d0 con 0x7f71a40d08d0 2024-09-21T01:49:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.324+0000 7f7199ffb640 1 -- 172.21.15.40:0/400611695 <== mon.2 v2:172.21.15.139:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194021060 con 0x7f71a40d08d0 2024-09-21T01:49:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.325+0000 7f4757fff640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f473c078bc0 0x7f473c07b0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47580ccb70 tx=0x7f474400f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.329+0000 7f47557fa640 1 -- 172.21.15.40:0/3071421501 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f474c09e030 con 0x7f47580cceb0 2024-09-21T01:49:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.329+0000 7f8dc57fa640 1 -- 172.21.15.40:0/3086449613 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8db40637e0 con 0x7f8dc815f9a0 2024-09-21T01:49:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.331+0000 7fe34affd640 1 -- 172.21.15.40:0/1870850635 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe350041030 con 0x7fe354069c30 2024-09-21T01:49:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.332+0000 7fe34affd640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe338078b90 0x7fe33807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.332+0000 7f7199ffb640 1 -- 172.21.15.40:0/400611695 <== mon.2 v2:172.21.15.139:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f719401a070 con 0x7f71a40d08d0 2024-09-21T01:49:51.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.332+0000 7f7199ffb640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7188078dc0 0x7f718807b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.332+0000 7fe34affd640 1 -- 172.21.15.40:0/1870850635 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe3500bb990 con 0x7fe354069c30 2024-09-21T01:49:51.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.333+0000 7f7199ffb640 1 -- 172.21.15.40:0/400611695 <== mon.2 v2:172.21.15.139:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f71940035f0 con 0x7f71a40d08d0 2024-09-21T01:49:51.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.333+0000 7fe359c27640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe338078b90 0x7fe33807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.333+0000 7f71a9156640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7188078dc0 0x7f718807b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.333+0000 7fe359c27640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe338078b90 0x7fe33807b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3540caa50 tx=0x7fe344005b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.334+0000 7f71a9156640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7188078dc0 0x7f718807b2d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009d50 tx=0x7f71a00090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.335+0000 7fe34affd640 1 -- 172.21.15.40:0/1870850635 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe350083db0 con 0x7fe354069c30 2024-09-21T01:49:51.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.339+0000 7f7199ffb640 1 -- 172.21.15.40:0/400611695 <== mon.2 v2:172.21.15.139:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7194066df0 con 0x7f71a40d08d0 2024-09-21T01:49:51.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.756+0000 7f9f9db50640 1 -- 172.21.15.40:0/3468707357 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9f980b4670 con 0x7f9f98071330 2024-09-21T01:49:51.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.758+0000 7f9f7ffff640 1 -- 172.21.15.40:0/3468707357 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f980b4670 con 0x7f9f98071330 2024-09-21T01:49:51.759 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-21T01:49:51.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.760+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4af4005580 con 0x7f4b140cfc10 2024-09-21T01:49:51.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.760+0000 7f4b10ff9640 1 -- 172.21.15.40:0/242158944 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b0c066a10 con 0x7f4b140cfc10 2024-09-21T01:49:51.762 INFO:teuthology.orchestra.run.smithi040.stdout:60129542153 2024-09-21T01:49:51.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.762+0000 7f9f7dffb640 1 -- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9f84078c10 msgr2=0x7f9f8407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.762+0000 7f9f7dffb640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9f84078c10 0x7f9f8407b120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c034000 tx=0x7f9f8c004730 comp rx=0 tx=0).stop 2024-09-21T01:49:51.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.762+0000 7f9f7dffb640 1 -- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9f98071330 msgr2=0x7f9f980cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.762+0000 7f9f7dffb640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9f98071330 0x7f9f980cb800 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c9a0 tx=0x7f9f8800ce60 comp rx=0 tx=0).stop 2024-09-21T01:49:51.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.762+0000 7f9f7dffb640 1 -- 172.21.15.40:0/3468707357 shutdown_connections 2024-09-21T01:49:51.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.762+0000 7f9f7dffb640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9f84078c10 0x7f9f8407b120 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.762+0000 7f9f7dffb640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f98155c70 0x7f9f980b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.762+0000 7f9f7dffb640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9f98074390 0x7f9f98145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.762+0000 7f9f7dffb640 1 --2- 172.21.15.40:0/3468707357 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9f98071330 0x7f9f980cb800 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.763+0000 7f9f7dffb640 1 -- 172.21.15.40:0/3468707357 >> 172.21.15.40:0/3468707357 conn(0x7f9f980b2e10 msgr2=0x7f9f980b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.763+0000 7f9f7dffb640 1 -- 172.21.15.40:0/3468707357 shutdown_connections 2024-09-21T01:49:51.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.763+0000 7f9f7dffb640 1 -- 172.21.15.40:0/3468707357 wait complete. 2024-09-21T01:49:51.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.764+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3dd815af20 con 0x7f3dd815f030 2024-09-21T01:49:51.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.764+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4b00078c90 msgr2=0x7f4b0007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.764+0000 7f4b1a901640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4b00078c90 0x7f4b0007b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b08008590 tx=0x7f4b08004730 comp rx=0 tx=0).stop 2024-09-21T01:49:51.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.764+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b140cfc10 msgr2=0x7f4b140ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.764+0000 7f4b1a901640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b140cfc10 0x7f4b140ae540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00cac0 tx=0x7f4b0c00cf80 comp rx=0 tx=0).stop 2024-09-21T01:49:51.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.764+0000 7f3dcdffb640 1 -- 172.21.15.40:0/1635296853 <== mon.1 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3dd0063350 con 0x7f3dd815f030 2024-09-21T01:49:51.767 INFO:teuthology.orchestra.run.smithi040.stdout:60129542152 2024-09-21T01:49:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.765+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 shutdown_connections 2024-09-21T01:49:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.765+0000 7f4b1a901640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4b00078c90 0x7f4b0007b1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.765+0000 7f4b1a901640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b140cfc10 0x7f4b140ae540 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.765+0000 7f4b1a901640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b1408b690 0x7f4b142028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.765+0000 7f4b1a901640 1 --2- 172.21.15.40:0/242158944 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b1408b140 0x7f4b1408a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.765+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 >> 172.21.15.40:0/242158944 conn(0x7f4b140b20a0 msgr2=0x7f4b140ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.766+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 shutdown_connections 2024-09-21T01:49:51.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.766+0000 7f4b1a901640 1 -- 172.21.15.40:0/242158944 wait complete. 2024-09-21T01:49:51.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.766+0000 7fe5e8ff9640 1 -- 172.21.15.40:0/2840476022 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe5f4141910 con 0x7fe5f4162d00 2024-09-21T01:49:51.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.767+0000 7fe5eaffd640 1 -- 172.21.15.40:0/2840476022 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe5f4141910 con 0x7fe5f4162d00 2024-09-21T01:49:51.769 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-09-21T01:49:51.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.768+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3dbc078be0 msgr2=0x7f3dbc07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.768+0000 7f3ddf64d640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3dbc078be0 0x7f3dbc07b0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4001220 tx=0x7f3dd4009040 comp rx=0 tx=0).stop 2024-09-21T01:49:51.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.768+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3dd815f030 msgr2=0x7f3dd815d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.769+0000 7f3ddf64d640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3dd815f030 0x7f3dd815d6c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000e960 tx=0x7f3dd000ed60 comp rx=0 tx=0).stop 2024-09-21T01:49:51.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.769+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 shutdown_connections 2024-09-21T01:49:51.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.769+0000 7f3ddf64d640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3dbc078be0 0x7f3dbc07b0f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.769+0000 7f3ddf64d640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3dd815f030 0x7f3dd815d6c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.769+0000 7f3ddf64d640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3dd80cec40 0x7f3dd8158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.769+0000 7f3ddf64d640 1 --2- 172.21.15.40:0/1635296853 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3dd80afa40 0x7f3dd8154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.769+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 >> 172.21.15.40:0/1635296853 conn(0x7f3dd80cd4b0 msgr2=0x7f3dd80b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.769+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 shutdown_connections 2024-09-21T01:49:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.769+0000 7f3ddf64d640 1 -- 172.21.15.40:0/1635296853 wait complete. 2024-09-21T01:49:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.771+0000 7fe5e8ff9640 1 -- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe5d8078c90 msgr2=0x7fe5d807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.771+0000 7fe5e8ff9640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe5d8078c90 0x7fe5d807b1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4001720 tx=0x7fe5e4007e90 comp rx=0 tx=0).stop 2024-09-21T01:49:51.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.771+0000 7f475ec64640 1 -- 172.21.15.40:0/3071421501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f475814e150 con 0x7f47580cceb0 2024-09-21T01:49:51.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.771+0000 7fe5e8ff9640 1 -- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5f4162d00 msgr2=0x7fe5f4143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.771+0000 7fe5e8ff9640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5f4162d00 0x7fe5f4143f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5f000b390 tx=0x7fe5f000b850 comp rx=0 tx=0).stop 2024-09-21T01:49:51.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.772+0000 7fe5e8ff9640 1 -- 172.21.15.40:0/2840476022 shutdown_connections 2024-09-21T01:49:51.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.772+0000 7fe5e8ff9640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe5d8078c90 0x7fe5d807b1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.772+0000 7fe5e8ff9640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe5f4162d00 0x7fe5f4143f80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.772+0000 7fe5e8ff9640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5f40b3640 0x7fe5f4143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.772+0000 7f47557fa640 1 -- 172.21.15.40:0/3071421501 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f474c022020 con 0x7f47580cceb0 2024-09-21T01:49:51.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.772+0000 7fe5e8ff9640 1 --2- 172.21.15.40:0/2840476022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f40b3230 0x7fe5f4141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.775 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-09-21T01:49:51.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.772+0000 7fe5e8ff9640 1 -- 172.21.15.40:0/2840476022 >> 172.21.15.40:0/2840476022 conn(0x7fe5f4070b20 msgr2=0x7fe5f415c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.775+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe3540caaa0 con 0x7fe354069c30 2024-09-21T01:49:51.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7fe5e8ff9640 1 -- 172.21.15.40:0/2840476022 shutdown_connections 2024-09-21T01:49:51.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7fe5e8ff9640 1 -- 172.21.15.40:0/2840476022 wait complete. 2024-09-21T01:49:51.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 -- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f473c078bc0 msgr2=0x7f473c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f473c078bc0 0x7f473c07b0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f47580ccb70 tx=0x7f474400f040 comp rx=0 tx=0).stop 2024-09-21T01:49:51.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 -- 172.21.15.40:0/3071421501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47580cceb0 msgr2=0x7f475809bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47580cceb0 0x7f475809bbb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f474c0078a0 tx=0x7f474c007d60 comp rx=0 tx=0).stop 2024-09-21T01:49:51.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 -- 172.21.15.40:0/3071421501 shutdown_connections 2024-09-21T01:49:51.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f473c078bc0 0x7f473c07b0d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f475815ef10 0x7f47580ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f475815a9b0 0x7f475814dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 --2- 172.21.15.40:0/3071421501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47580cceb0 0x7f475809bbb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 -- 172.21.15.40:0/3071421501 >> 172.21.15.40:0/3071421501 conn(0x7f475806d7d0 msgr2=0x7f4758159e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7fe34affd640 1 -- 172.21.15.40:0/1870850635 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe3500836b0 con 0x7fe354069c30 2024-09-21T01:49:51.779 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-09-21T01:49:51.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.776+0000 7f4742ffd640 1 -- 172.21.15.40:0/3071421501 shutdown_connections 2024-09-21T01:49:51.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.777+0000 7f4742ffd640 1 -- 172.21.15.40:0/3071421501 wait complete. 2024-09-21T01:49:51.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.778+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f71a406f940 con 0x7f71a40d08d0 2024-09-21T01:49:51.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.779+0000 7f7199ffb640 1 -- 172.21.15.40:0/400611695 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f719406bca0 con 0x7f71a40d08d0 2024-09-21T01:49:51.780 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-09-21T01:49:51.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.780+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe338078b90 msgr2=0x7fe33807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.780+0000 7fe35c68c640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe338078b90 0x7fe33807b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3540caa50 tx=0x7fe344005b60 comp rx=0 tx=0).stop 2024-09-21T01:49:51.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.780+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe354069c30 msgr2=0x7fe3541554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.780+0000 7fe35c68c640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe354069c30 0x7fe3541554c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe350034040 tx=0x7fe350003820 comp rx=0 tx=0).stop 2024-09-21T01:49:51.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.781+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8da8005850 con 0x7f8dc815f9a0 2024-09-21T01:49:51.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.781+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 shutdown_connections 2024-09-21T01:49:51.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.781+0000 7fe35c68c640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe338078b90 0x7fe33807b0a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.781+0000 7fe35c68c640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe35415bb20 0x7fe3540b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.781+0000 7fe35c68c640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3540ce930 0x7fe3540b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.781+0000 7fe35c68c640 1 --2- 172.21.15.40:0/1870850635 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe354069c30 0x7fe3541554c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.781+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 >> 172.21.15.40:0/1870850635 conn(0x7fe3540b21d0 msgr2=0x7fe35415ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.781+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 shutdown_connections 2024-09-21T01:49:51.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.781+0000 7f8dc57fa640 1 -- 172.21.15.40:0/3086449613 <== mon.2 v2:172.21.15.139:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8db40630e0 con 0x7f8dc815f9a0 2024-09-21T01:49:51.785 INFO:teuthology.orchestra.run.smithi040.stdout:64424509449 2024-09-21T01:49:51.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.783+0000 7fe35c68c640 1 -- 172.21.15.40:0/1870850635 wait complete. 2024-09-21T01:49:51.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8dac078be0 msgr2=0x7f8dac07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7188078dc0 msgr2=0x7f718807b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.2 2024-09-21T01:49:51.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7188078dc0 0x7f718807b2d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009d50 tx=0x7f71a00090e0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8dac078be0 0x7f8dac07b0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009a30 tx=0x7f8dbc005f90 comp rx=0 tx=0).stop 2024-09-21T01:49:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc815f9a0 msgr2=0x7f8dc80ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc815f9a0 0x7f8dc80ae250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8db400d770 tx=0x7f8db400dc30 comp rx=0 tx=0).stop 2024-09-21T01:49:51.788 DEBUG:teuthology.parallel:result is None 2024-09-21T01:49:51.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a40d08d0 msgr2=0x7f71a4159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a40d08d0 0x7f71a4159290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f719400c310 tx=0x7f719400c7d0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 shutdown_connections 2024-09-21T01:49:51.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7188078dc0 0x7f718807b2d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71a40d2a00 0x7f71a4201760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f71a40d08d0 0x7f71a4159290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 --2- 172.21.15.40:0/400611695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71a40d04c0 0x7f71a406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 >> 172.21.15.40:0/400611695 conn(0x7f71a4072ae0 msgr2=0x7f71a414fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 shutdown_connections 2024-09-21T01:49:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 shutdown_connections 2024-09-21T01:49:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8dac078be0 0x7f8dac07b0f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f71ab3ba640 1 -- 172.21.15.40:0/400611695 wait complete. 2024-09-21T01:49:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8dc81624d0 0x7f8dc80ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8dc815f9a0 0x7f8dc80ae250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 --2- 172.21.15.40:0/3086449613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8dc80ccde0 0x7f8dc8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.785+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 >> 172.21.15.40:0/3086449613 conn(0x7f8dc80b20a0 msgr2=0x7f8dc806f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.786+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 shutdown_connections 2024-09-21T01:49:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.786+0000 7f8dcf194640 1 -- 172.21.15.40:0/3086449613 wait complete. 2024-09-21T01:49:51.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-09-21T01:49:51.792 DEBUG:teuthology.parallel:result is None 2024-09-21T01:49:51.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.1 2024-09-21T01:49:51.793 DEBUG:teuthology.parallel:result is None 2024-09-21T01:49:51.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-09-21T01:49:51.798 DEBUG:teuthology.parallel:result is None 2024-09-21T01:49:51.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-21T01:49:51.801 DEBUG:teuthology.parallel:result is None 2024-09-21T01:49:51.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-21T01:49:51.804 DEBUG:teuthology.parallel:result is None 2024-09-21T01:49:51.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-09-21T01:49:51.807 DEBUG:teuthology.parallel:result is None 2024-09-21T01:49:51.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-09-21T01:49:51.808 DEBUG:teuthology.parallel:result is None 2024-09-21T01:49:51.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T01:49:51.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:49:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.962+0000 7f4ac9939640 1 -- 172.21.15.40:0/775140546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4ac4155aa0 msgr2=0x7f4ac40d0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.962+0000 7f4ac9939640 1 --2- 172.21.15.40:0/775140546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4ac4155aa0 0x7f4ac40d0340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4005fd0 tx=0x7f4ab402a540 comp rx=0 tx=0).stop 2024-09-21T01:49:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.962+0000 7f4ac9939640 1 -- 172.21.15.40:0/775140546 shutdown_connections 2024-09-21T01:49:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.962+0000 7f4ac9939640 1 --2- 172.21.15.40:0/775140546 >> v2:172.21.15.139:3300/0 conn(0x7f4ac4075e40 0x7f4ac415f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.962+0000 7f4ac9939640 1 --2- 172.21.15.40:0/775140546 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4ac4155aa0 0x7f4ac40d0340 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.962+0000 7f4ac9939640 1 -- 172.21.15.40:0/775140546 >> 172.21.15.40:0/775140546 conn(0x7f4ac40cd480 msgr2=0x7f4ac40cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:51.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.962+0000 7f4ac9939640 1 -- 172.21.15.40:0/775140546 shutdown_connections 2024-09-21T01:49:51.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.962+0000 7f4ac9939640 1 -- 172.21.15.40:0/775140546 wait complete. 2024-09-21T01:49:51.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.964+0000 7f4ac9939640 1 Processor -- start 2024-09-21T01:49:51.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.964+0000 7f4ac9939640 1 -- start start 2024-09-21T01:49:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.965+0000 7f4ac9939640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ac4075e40 0x7f4ac41f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.965+0000 7f4ac9939640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ac4155aa0 0x7f4ac4140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.965+0000 7f4ac9939640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4ac415f5c0 0x7f4ac41f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.965+0000 7f4ac9939640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac406e690 con 0x7f4ac4075e40 2024-09-21T01:49:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.965+0000 7f4ac9939640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac406e510 con 0x7f4ac4155aa0 2024-09-21T01:49:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.965+0000 7f4ac9939640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac40c5fb0 con 0x7f4ac415f5c0 2024-09-21T01:49:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ac4075e40 0x7f4ac41f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ac4075e40 0x7f4ac41f72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33472/0 (socket says 172.21.15.40:33472) 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac2ffd640 1 -- 172.21.15.40:0/2590544050 learned_addr learned my addr 172.21.15.40:0/2590544050 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac37fe640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4ac415f5c0 0x7f4ac41f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac27fc640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ac4155aa0 0x7f4ac4140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac2ffd640 1 -- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4ac415f5c0 msgr2=0x7f4ac41f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac2ffd640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4ac415f5c0 0x7f4ac41f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac2ffd640 1 -- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ac4155aa0 msgr2=0x7f4ac4140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac2ffd640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ac4155aa0 0x7f4ac4140370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac2ffd640 1 -- 172.21.15.40:0/2590544050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac414f1a0 con 0x7f4ac4075e40 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac2ffd640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ac4075e40 0x7f4ac41f72c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000c00 tx=0x7f4ab40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4abbfff640 1 -- 172.21.15.40:0/2590544050 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab403e030 con 0x7f4ac4075e40 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4abbfff640 1 -- 172.21.15.40:0/2590544050 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ab4003ca0 con 0x7f4ac4075e40 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac414e620 con 0x7f4ac4075e40 2024-09-21T01:49:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.966+0000 7f4abbfff640 1 -- 172.21.15.40:0/2590544050 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4035040 con 0x7f4ac4075e40 2024-09-21T01:49:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.967+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac414ebe0 con 0x7f4ac4075e40 2024-09-21T01:49:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.968+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac40c6440 con 0x7f4ac4075e40 2024-09-21T01:49:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.968+0000 7f4abbfff640 1 -- 172.21.15.40:0/2590544050 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ab4041030 con 0x7f4ac4075e40 2024-09-21T01:49:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.969+0000 7f4abbfff640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4aa4078b90 0x7f4aa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:51.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.969+0000 7f4abbfff640 1 -- 172.21.15.40:0/2590544050 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4ab40bb3d0 con 0x7f4ac4075e40 2024-09-21T01:49:51.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.969+0000 7f4ac27fc640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4aa4078b90 0x7f4aa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:51.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.969+0000 7f4ac27fc640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4aa4078b90 0x7f4aa407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4071410 tx=0x7f4aac005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:51.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:51.974+0000 7f4abbfff640 1 -- 172.21.15.40:0/2590544050 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4ab40831d0 con 0x7f4ac4075e40 2024-09-21T01:49:52.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.157+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 --> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ac40008d0 con 0x7f4aa4078b90 2024-09-21T01:49:52.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.162+0000 7f4abbfff640 1 -- 172.21.15.40:0/2590544050 <== mgr.4100 v2:172.21.15.139:6800/852736644 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f4ac40008d0 con 0x7f4aa4078b90 2024-09-21T01:49:52.166 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:52.167 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4aa4078b90 msgr2=0x7f4aa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4aa4078b90 0x7f4aa407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4071410 tx=0x7f4aac005f90 comp rx=0 tx=0).stop 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ac4075e40 msgr2=0x7f4ac41f72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ac4075e40 0x7f4ac41f72c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000c00 tx=0x7f4ab40038a0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 shutdown_connections 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4aa4078b90 0x7f4aa407b0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4ac415f5c0 0x7f4ac41f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4ac4155aa0 0x7f4ac4140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 --2- 172.21.15.40:0/2590544050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ac4075e40 0x7f4ac41f72c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 >> 172.21.15.40:0/2590544050 conn(0x7f4ac40cd480 msgr2=0x7f4ac415ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 shutdown_connections 2024-09-21T01:49:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.165+0000 7f4ac9939640 1 -- 172.21.15.40:0/2590544050 wait complete. 2024-09-21T01:49:52.177 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-21T01:49:51.312037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2924544,"data_stored":1761292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003073"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737960+0000","last_change":"2024-09-21T01:49:40.356030+0000","last_active":"2024-09-21T01:49:41.737960+0000","last_peered":"2024-09-21T01:49:41.737960+0000","last_clean":"2024-09-21T01:49:41.737960+0000","last_became_active":"2024-09-21T01:49:40.355677+0000","last_became_peered":"2024-09-21T01:49:40.355677+0000","last_unstale":"2024-09-21T01:49:41.737960+0000","last_undegraded":"2024-09-21T01:49:41.737960+0000","last_fullsized":"2024-09-21T01:49:41.737960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:57.340502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736421+0000","last_change":"2024-09-21T01:49:40.366361+0000","last_active":"2024-09-21T01:49:41.736421+0000","last_peered":"2024-09-21T01:49:41.736421+0000","last_clean":"2024-09-21T01:49:41.736421+0000","last_became_active":"2024-09-21T01:49:40.366008+0000","last_became_peered":"2024-09-21T01:49:40.366008+0000","last_unstale":"2024-09-21T01:49:41.736421+0000","last_undegraded":"2024-09-21T01:49:41.736421+0000","last_fullsized":"2024-09-21T01:49:41.736421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:30.129619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350613+0000","last_change":"2024-09-21T01:49:40.349571+0000","last_active":"2024-09-21T01:49:41.350613+0000","last_peered":"2024-09-21T01:49:41.350613+0000","last_clean":"2024-09-21T01:49:41.350613+0000","last_became_active":"2024-09-21T01:49:40.349241+0000","last_became_peered":"2024-09-21T01:49:40.349241+0000","last_unstale":"2024-09-21T01:49:41.350613+0000","last_undegraded":"2024-09-21T01:49:41.350613+0000","last_fullsized":"2024-09-21T01:49:41.350613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.999168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736794+0000","last_change":"2024-09-21T01:49:40.372236+0000","last_active":"2024-09-21T01:49:41.736794+0000","last_peered":"2024-09-21T01:49:41.736794+0000","last_clean":"2024-09-21T01:49:41.736794+0000","last_became_active":"2024-09-21T01:49:40.371944+0000","last_became_peered":"2024-09-21T01:49:40.371944+0000","last_unstale":"2024-09-21T01:49:41.736794+0000","last_undegraded":"2024-09-21T01:49:41.736794+0000","last_fullsized":"2024-09-21T01:49:41.736794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:26.563781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737255+0000","last_change":"2024-09-21T01:49:40.358244+0000","last_active":"2024-09-21T01:49:41.737255+0000","last_peered":"2024-09-21T01:49:41.737255+0000","last_clean":"2024-09-21T01:49:41.737255+0000","last_became_active":"2024-09-21T01:49:40.357953+0000","last_became_peered":"2024-09-21T01:49:40.357953+0000","last_unstale":"2024-09-21T01:49:41.737255+0000","last_undegraded":"2024-09-21T01:49:41.737255+0000","last_fullsized":"2024-09-21T01:49:41.737255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:52.645109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736458+0000","last_change":"2024-09-21T01:49:40.370563+0000","last_active":"2024-09-21T01:49:41.736458+0000","last_peered":"2024-09-21T01:49:41.736458+0000","last_clean":"2024-09-21T01:49:41.736458+0000","last_became_active":"2024-09-21T01:49:40.369831+0000","last_became_peered":"2024-09-21T01:49:40.369831+0000","last_unstale":"2024-09-21T01:49:41.736458+0000","last_undegraded":"2024-09-21T01:49:41.736458+0000","last_fullsized":"2024-09-21T01:49:41.736458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736598+0000","last_change":"2024-09-21T01:49:40.364668+0000","last_active":"2024-09-21T01:49:41.736598+0000","last_peered":"2024-09-21T01:49:41.736598+0000","last_clean":"2024-09-21T01:49:41.736598+0000","last_became_active":"2024-09-21T01:49:40.363159+0000","last_became_peered":"2024-09-21T01:49:40.363159+0000","last_unstale":"2024-09-21T01:49:41.736598+0000","last_undegraded":"2024-09-21T01:49:41.736598+0000","last_fullsized":"2024-09-21T01:49:41.736598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:36.062812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351404+0000","last_change":"2024-09-21T01:49:40.363639+0000","last_active":"2024-09-21T01:49:41.351404+0000","last_peered":"2024-09-21T01:49:41.351404+0000","last_clean":"2024-09-21T01:49:41.351404+0000","last_became_active":"2024-09-21T01:49:40.363291+0000","last_became_peered":"2024-09-21T01:49:40.363291+0000","last_unstale":"2024-09-21T01:49:41.351404+0000","last_undegraded":"2024-09-21T01:49:41.351404+0000","last_fullsized":"2024-09-21T01:49:41.351404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:03.841294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737999+0000","last_change":"2024-09-21T01:49:40.366167+0000","last_active":"2024-09-21T01:49:41.737999+0000","last_peered":"2024-09-21T01:49:41.737999+0000","last_clean":"2024-09-21T01:49:41.737999+0000","last_became_active":"2024-09-21T01:49:40.364598+0000","last_became_peered":"2024-09-21T01:49:40.364598+0000","last_unstale":"2024-09-21T01:49:41.737999+0000","last_undegraded":"2024-09-21T01:49:41.737999+0000","last_fullsized":"2024-09-21T01:49:41.737999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:36.012884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535590+0000","last_change":"2024-09-21T01:49:40.368687+0000","last_active":"2024-09-21T01:49:41.535590+0000","last_peered":"2024-09-21T01:49:41.535590+0000","last_clean":"2024-09-21T01:49:41.535590+0000","last_became_active":"2024-09-21T01:49:40.366584+0000","last_became_peered":"2024-09-21T01:49:40.366584+0000","last_unstale":"2024-09-21T01:49:41.535590+0000","last_undegraded":"2024-09-21T01:49:41.535590+0000","last_fullsized":"2024-09-21T01:49:41.535590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535321+0000","last_change":"2024-09-21T01:49:40.358569+0000","last_active":"2024-09-21T01:49:41.535321+0000","last_peered":"2024-09-21T01:49:41.535321+0000","last_clean":"2024-09-21T01:49:41.535321+0000","last_became_active":"2024-09-21T01:49:40.358189+0000","last_became_peered":"2024-09-21T01:49:40.358189+0000","last_unstale":"2024-09-21T01:49:41.535321+0000","last_undegraded":"2024-09-21T01:49:41.535321+0000","last_fullsized":"2024-09-21T01:49:41.535321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.668625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353509+0000","last_change":"2024-09-21T01:49:40.360227+0000","last_active":"2024-09-21T01:49:41.353509+0000","last_peered":"2024-09-21T01:49:41.353509+0000","last_clean":"2024-09-21T01:49:41.353509+0000","last_became_active":"2024-09-21T01:49:40.359457+0000","last_became_peered":"2024-09-21T01:49:40.359457+0000","last_unstale":"2024-09-21T01:49:41.353509+0000","last_undegraded":"2024-09-21T01:49:41.353509+0000","last_fullsized":"2024-09-21T01:49:41.353509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:44.985230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352280+0000","last_change":"2024-09-21T01:49:40.356310+0000","last_active":"2024-09-21T01:49:41.352280+0000","last_peered":"2024-09-21T01:49:41.352280+0000","last_clean":"2024-09-21T01:49:41.352280+0000","last_became_active":"2024-09-21T01:49:40.356004+0000","last_became_peered":"2024-09-21T01:49:40.356004+0000","last_unstale":"2024-09-21T01:49:41.352280+0000","last_undegraded":"2024-09-21T01:49:41.352280+0000","last_fullsized":"2024-09-21T01:49:41.352280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:14.949645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350350+0000","last_change":"2024-09-21T01:49:40.354886+0000","last_active":"2024-09-21T01:49:41.350350+0000","last_peered":"2024-09-21T01:49:41.350350+0000","last_clean":"2024-09-21T01:49:41.350350+0000","last_became_active":"2024-09-21T01:49:40.354489+0000","last_became_peered":"2024-09-21T01:49:40.354489+0000","last_unstale":"2024-09-21T01:49:41.350350+0000","last_undegraded":"2024-09-21T01:49:41.350350+0000","last_fullsized":"2024-09-21T01:49:41.350350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:43.940906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736359+0000","last_change":"2024-09-21T01:49:40.364466+0000","last_active":"2024-09-21T01:49:41.736359+0000","last_peered":"2024-09-21T01:49:41.736359+0000","last_clean":"2024-09-21T01:49:41.736359+0000","last_became_active":"2024-09-21T01:49:40.364098+0000","last_became_peered":"2024-09-21T01:49:40.364098+0000","last_unstale":"2024-09-21T01:49:41.736359+0000","last_undegraded":"2024-09-21T01:49:41.736359+0000","last_fullsized":"2024-09-21T01:49:41.736359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:24.593410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736538+0000","last_change":"2024-09-21T01:49:40.370361+0000","last_active":"2024-09-21T01:49:41.736538+0000","last_peered":"2024-09-21T01:49:41.736538+0000","last_clean":"2024-09-21T01:49:41.736538+0000","last_became_active":"2024-09-21T01:49:40.370046+0000","last_became_peered":"2024-09-21T01:49:40.370046+0000","last_unstale":"2024-09-21T01:49:41.736538+0000","last_undegraded":"2024-09-21T01:49:41.736538+0000","last_fullsized":"2024-09-21T01:49:41.736538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:35.506009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737746+0000","last_change":"2024-09-21T01:49:40.364197+0000","last_active":"2024-09-21T01:49:41.737746+0000","last_peered":"2024-09-21T01:49:41.737746+0000","last_clean":"2024-09-21T01:49:41.737746+0000","last_became_active":"2024-09-21T01:49:40.363906+0000","last_became_peered":"2024-09-21T01:49:40.363906+0000","last_unstale":"2024-09-21T01:49:41.737746+0000","last_undegraded":"2024-09-21T01:49:41.737746+0000","last_fullsized":"2024-09-21T01:49:41.737746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:40.514781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736268+0000","last_change":"2024-09-21T01:49:40.369575+0000","last_active":"2024-09-21T01:49:41.736268+0000","last_peered":"2024-09-21T01:49:41.736268+0000","last_clean":"2024-09-21T01:49:41.736268+0000","last_became_active":"2024-09-21T01:49:40.369160+0000","last_became_peered":"2024-09-21T01:49:40.369160+0000","last_unstale":"2024-09-21T01:49:41.736268+0000","last_undegraded":"2024-09-21T01:49:41.736268+0000","last_fullsized":"2024-09-21T01:49:41.736268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:32.326084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737961+0000","last_change":"2024-09-21T01:49:40.357275+0000","last_active":"2024-09-21T01:49:41.737961+0000","last_peered":"2024-09-21T01:49:41.737961+0000","last_clean":"2024-09-21T01:49:41.737961+0000","last_became_active":"2024-09-21T01:49:40.356956+0000","last_became_peered":"2024-09-21T01:49:40.356956+0000","last_unstale":"2024-09-21T01:49:41.737961+0000","last_undegraded":"2024-09-21T01:49:41.737961+0000","last_fullsized":"2024-09-21T01:49:41.737961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:09.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535522+0000","last_change":"2024-09-21T01:49:40.366142+0000","last_active":"2024-09-21T01:49:41.535522+0000","last_peered":"2024-09-21T01:49:41.535522+0000","last_clean":"2024-09-21T01:49:41.535522+0000","last_became_active":"2024-09-21T01:49:40.365863+0000","last_became_peered":"2024-09-21T01:49:40.365863+0000","last_unstale":"2024-09-21T01:49:41.535522+0000","last_undegraded":"2024-09-21T01:49:41.535522+0000","last_fullsized":"2024-09-21T01:49:41.535522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:24.814662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350661+0000","last_change":"2024-09-21T01:49:40.350221+0000","last_active":"2024-09-21T01:49:41.350661+0000","last_peered":"2024-09-21T01:49:41.350661+0000","last_clean":"2024-09-21T01:49:41.350661+0000","last_became_active":"2024-09-21T01:49:40.349898+0000","last_became_peered":"2024-09-21T01:49:40.349898+0000","last_unstale":"2024-09-21T01:49:41.350661+0000","last_undegraded":"2024-09-21T01:49:41.350661+0000","last_fullsized":"2024-09-21T01:49:41.350661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:12.766064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737119+0000","last_change":"2024-09-21T01:49:40.370844+0000","last_active":"2024-09-21T01:49:41.737119+0000","last_peered":"2024-09-21T01:49:41.737119+0000","last_clean":"2024-09-21T01:49:41.737119+0000","last_became_active":"2024-09-21T01:49:40.369354+0000","last_became_peered":"2024-09-21T01:49:40.369354+0000","last_unstale":"2024-09-21T01:49:41.737119+0000","last_undegraded":"2024-09-21T01:49:41.737119+0000","last_fullsized":"2024-09-21T01:49:41.737119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.916601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351626+0000","last_change":"2024-09-21T01:49:40.352293+0000","last_active":"2024-09-21T01:49:41.351626+0000","last_peered":"2024-09-21T01:49:41.351626+0000","last_clean":"2024-09-21T01:49:41.351626+0000","last_became_active":"2024-09-21T01:49:40.351973+0000","last_became_peered":"2024-09-21T01:49:40.351973+0000","last_unstale":"2024-09-21T01:49:41.351626+0000","last_undegraded":"2024-09-21T01:49:41.351626+0000","last_fullsized":"2024-09-21T01:49:41.351626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:12.766064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736452+0000","last_change":"2024-09-21T01:49:40.371534+0000","last_active":"2024-09-21T01:49:41.736452+0000","last_peered":"2024-09-21T01:49:41.736452+0000","last_clean":"2024-09-21T01:49:41.736452+0000","last_became_active":"2024-09-21T01:49:40.371235+0000","last_became_peered":"2024-09-21T01:49:40.371235+0000","last_unstale":"2024-09-21T01:49:41.736452+0000","last_undegraded":"2024-09-21T01:49:41.736452+0000","last_fullsized":"2024-09-21T01:49:41.736452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351780+0000","last_change":"2024-09-21T01:49:40.361289+0000","last_active":"2024-09-21T01:49:41.351780+0000","last_peered":"2024-09-21T01:49:41.351780+0000","last_clean":"2024-09-21T01:49:41.351780+0000","last_became_active":"2024-09-21T01:49:40.360952+0000","last_became_peered":"2024-09-21T01:49:40.360952+0000","last_unstale":"2024-09-21T01:49:41.351780+0000","last_undegraded":"2024-09-21T01:49:41.351780+0000","last_fullsized":"2024-09-21T01:49:41.351780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:58.888642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535608+0000","last_change":"2024-09-21T01:49:40.356406+0000","last_active":"2024-09-21T01:49:41.535608+0000","last_peered":"2024-09-21T01:49:41.535608+0000","last_clean":"2024-09-21T01:49:41.535608+0000","last_became_active":"2024-09-21T01:49:40.355941+0000","last_became_peered":"2024-09-21T01:49:40.355941+0000","last_unstale":"2024-09-21T01:49:41.535608+0000","last_undegraded":"2024-09-21T01:49:41.535608+0000","last_fullsized":"2024-09-21T01:49:41.535608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736560+0000","last_change":"2024-09-21T01:49:40.354384+0000","last_active":"2024-09-21T01:49:41.736560+0000","last_peered":"2024-09-21T01:49:41.736560+0000","last_clean":"2024-09-21T01:49:41.736560+0000","last_became_active":"2024-09-21T01:49:40.354065+0000","last_became_peered":"2024-09-21T01:49:40.354065+0000","last_unstale":"2024-09-21T01:49:41.736560+0000","last_undegraded":"2024-09-21T01:49:41.736560+0000","last_fullsized":"2024-09-21T01:49:41.736560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:43.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352248+0000","last_change":"2024-09-21T01:49:40.347679+0000","last_active":"2024-09-21T01:49:41.352248+0000","last_peered":"2024-09-21T01:49:41.352248+0000","last_clean":"2024-09-21T01:49:41.352248+0000","last_became_active":"2024-09-21T01:49:40.347302+0000","last_became_peered":"2024-09-21T01:49:40.347302+0000","last_unstale":"2024-09-21T01:49:41.352248+0000","last_undegraded":"2024-09-21T01:49:41.352248+0000","last_fullsized":"2024-09-21T01:49:41.352248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:00.866709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351058+0000","last_change":"2024-09-21T01:49:40.351144+0000","last_active":"2024-09-21T01:49:41.351058+0000","last_peered":"2024-09-21T01:49:41.351058+0000","last_clean":"2024-09-21T01:49:41.351058+0000","last_became_active":"2024-09-21T01:49:40.350778+0000","last_became_peered":"2024-09-21T01:49:40.350778+0000","last_unstale":"2024-09-21T01:49:41.351058+0000","last_undegraded":"2024-09-21T01:49:41.351058+0000","last_fullsized":"2024-09-21T01:49:41.351058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737667+0000","last_change":"2024-09-21T01:49:40.372249+0000","last_active":"2024-09-21T01:49:41.737667+0000","last_peered":"2024-09-21T01:49:41.737667+0000","last_clean":"2024-09-21T01:49:41.737667+0000","last_became_active":"2024-09-21T01:49:40.371920+0000","last_became_peered":"2024-09-21T01:49:40.371920+0000","last_unstale":"2024-09-21T01:49:41.737667+0000","last_undegraded":"2024-09-21T01:49:41.737667+0000","last_fullsized":"2024-09-21T01:49:41.737667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:57.340502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735902+0000","last_change":"2024-09-21T01:49:40.365077+0000","last_active":"2024-09-21T01:49:41.735902+0000","last_peered":"2024-09-21T01:49:41.735902+0000","last_clean":"2024-09-21T01:49:41.735902+0000","last_became_active":"2024-09-21T01:49:40.364475+0000","last_became_peered":"2024-09-21T01:49:40.364475+0000","last_unstale":"2024-09-21T01:49:41.735902+0000","last_undegraded":"2024-09-21T01:49:41.735902+0000","last_fullsized":"2024-09-21T01:49:41.735902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:16.394801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535444+0000","last_change":"2024-09-21T01:49:40.364957+0000","last_active":"2024-09-21T01:49:41.535444+0000","last_peered":"2024-09-21T01:49:41.535444+0000","last_clean":"2024-09-21T01:49:41.535444+0000","last_became_active":"2024-09-21T01:49:40.363773+0000","last_became_peered":"2024-09-21T01:49:40.363773+0000","last_unstale":"2024-09-21T01:49:41.535444+0000","last_undegraded":"2024-09-21T01:49:41.535444+0000","last_fullsized":"2024-09-21T01:49:41.535444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:36.817174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353667+0000","last_change":"2024-09-21T01:49:40.362548+0000","last_active":"2024-09-21T01:49:41.353667+0000","last_peered":"2024-09-21T01:49:41.353667+0000","last_clean":"2024-09-21T01:49:41.353667+0000","last_became_active":"2024-09-21T01:49:40.362006+0000","last_became_peered":"2024-09-21T01:49:40.362006+0000","last_unstale":"2024-09-21T01:49:41.353667+0000","last_undegraded":"2024-09-21T01:49:41.353667+0000","last_fullsized":"2024-09-21T01:49:41.353667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:09:20.837466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352351+0000","last_change":"2024-09-21T01:49:39.354635+0000","last_active":"2024-09-21T01:49:41.352351+0000","last_peered":"2024-09-21T01:49:41.352351+0000","last_clean":"2024-09-21T01:49:41.352351+0000","last_became_active":"2024-09-21T01:49:39.354261+0000","last_became_peered":"2024-09-21T01:49:39.354261+0000","last_unstale":"2024-09-21T01:49:41.352351+0000","last_undegraded":"2024-09-21T01:49:41.352351+0000","last_fullsized":"2024-09-21T01:49:41.352351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:43.205610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350925+0000","last_change":"2024-09-21T01:49:40.356386+0000","last_active":"2024-09-21T01:49:41.350925+0000","last_peered":"2024-09-21T01:49:41.350925+0000","last_clean":"2024-09-21T01:49:41.350925+0000","last_became_active":"2024-09-21T01:49:40.356070+0000","last_became_peered":"2024-09-21T01:49:40.356070+0000","last_unstale":"2024-09-21T01:49:41.350925+0000","last_undegraded":"2024-09-21T01:49:41.350925+0000","last_fullsized":"2024-09-21T01:49:41.350925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535066+0000","last_change":"2024-09-21T01:49:39.345519+0000","last_active":"2024-09-21T01:49:41.535066+0000","last_peered":"2024-09-21T01:49:41.535066+0000","last_clean":"2024-09-21T01:49:41.535066+0000","last_became_active":"2024-09-21T01:49:39.345204+0000","last_became_peered":"2024-09-21T01:49:39.345204+0000","last_unstale":"2024-09-21T01:49:41.535066+0000","last_undegraded":"2024-09-21T01:49:41.535066+0000","last_fullsized":"2024-09-21T01:49:41.535066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:43.979023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351716+0000","last_change":"2024-09-21T01:49:39.348849+0000","last_active":"2024-09-21T01:49:41.351716+0000","last_peered":"2024-09-21T01:49:41.351716+0000","last_clean":"2024-09-21T01:49:41.351716+0000","last_became_active":"2024-09-21T01:49:39.348541+0000","last_became_peered":"2024-09-21T01:49:39.348541+0000","last_unstale":"2024-09-21T01:49:41.351716+0000","last_undegraded":"2024-09-21T01:49:41.351716+0000","last_fullsized":"2024-09-21T01:49:41.351716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:45.215963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351473+0000","last_change":"2024-09-21T01:49:40.357207+0000","last_active":"2024-09-21T01:49:41.351473+0000","last_peered":"2024-09-21T01:49:41.351473+0000","last_clean":"2024-09-21T01:49:41.351473+0000","last_became_active":"2024-09-21T01:49:40.356888+0000","last_became_peered":"2024-09-21T01:49:40.356888+0000","last_unstale":"2024-09-21T01:49:41.351473+0000","last_undegraded":"2024-09-21T01:49:41.351473+0000","last_fullsized":"2024-09-21T01:49:41.351473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:47.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736549+0000","last_change":"2024-09-21T01:49:39.358208+0000","last_active":"2024-09-21T01:49:41.736549+0000","last_peered":"2024-09-21T01:49:41.736549+0000","last_clean":"2024-09-21T01:49:41.736549+0000","last_became_active":"2024-09-21T01:49:39.357751+0000","last_became_peered":"2024-09-21T01:49:39.357751+0000","last_unstale":"2024-09-21T01:49:41.736549+0000","last_undegraded":"2024-09-21T01:49:41.736549+0000","last_fullsized":"2024-09-21T01:49:41.736549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:17.291066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736125+0000","last_change":"2024-09-21T01:49:40.352449+0000","last_active":"2024-09-21T01:49:41.736125+0000","last_peered":"2024-09-21T01:49:41.736125+0000","last_clean":"2024-09-21T01:49:41.736125+0000","last_became_active":"2024-09-21T01:49:40.352149+0000","last_became_peered":"2024-09-21T01:49:40.352149+0000","last_unstale":"2024-09-21T01:49:41.736125+0000","last_undegraded":"2024-09-21T01:49:41.736125+0000","last_fullsized":"2024-09-21T01:49:41.736125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:11.903566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535350+0000","last_change":"2024-09-21T01:49:39.356457+0000","last_active":"2024-09-21T01:49:41.535350+0000","last_peered":"2024-09-21T01:49:41.535350+0000","last_clean":"2024-09-21T01:49:41.535350+0000","last_became_active":"2024-09-21T01:49:39.356087+0000","last_became_peered":"2024-09-21T01:49:39.356087+0000","last_unstale":"2024-09-21T01:49:41.535350+0000","last_undegraded":"2024-09-21T01:49:41.535350+0000","last_fullsized":"2024-09-21T01:49:41.535350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:02.371670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737704+0000","last_change":"2024-09-21T01:49:40.356593+0000","last_active":"2024-09-21T01:49:41.737704+0000","last_peered":"2024-09-21T01:49:41.737704+0000","last_clean":"2024-09-21T01:49:41.737704+0000","last_became_active":"2024-09-21T01:49:40.356244+0000","last_became_peered":"2024-09-21T01:49:40.356244+0000","last_unstale":"2024-09-21T01:49:41.737704+0000","last_undegraded":"2024-09-21T01:49:41.737704+0000","last_fullsized":"2024-09-21T01:49:41.737704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:34.045247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737251+0000","last_change":"2024-09-21T01:49:39.356069+0000","last_active":"2024-09-21T01:49:41.737251+0000","last_peered":"2024-09-21T01:49:41.737251+0000","last_clean":"2024-09-21T01:49:41.737251+0000","last_became_active":"2024-09-21T01:49:39.355711+0000","last_became_peered":"2024-09-21T01:49:39.355711+0000","last_unstale":"2024-09-21T01:49:41.737251+0000","last_undegraded":"2024-09-21T01:49:41.737251+0000","last_fullsized":"2024-09-21T01:49:41.737251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:26.423985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350888+0000","last_change":"2024-09-21T01:49:40.365005+0000","last_active":"2024-09-21T01:49:41.350888+0000","last_peered":"2024-09-21T01:49:41.350888+0000","last_clean":"2024-09-21T01:49:41.350888+0000","last_became_active":"2024-09-21T01:49:40.364593+0000","last_became_peered":"2024-09-21T01:49:40.364593+0000","last_unstale":"2024-09-21T01:49:41.350888+0000","last_undegraded":"2024-09-21T01:49:41.350888+0000","last_fullsized":"2024-09-21T01:49:41.350888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:24.814662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736394+0000","last_change":"2024-09-21T01:49:39.354177+0000","last_active":"2024-09-21T01:49:41.736394+0000","last_peered":"2024-09-21T01:49:41.736394+0000","last_clean":"2024-09-21T01:49:41.736394+0000","last_became_active":"2024-09-21T01:49:39.353830+0000","last_became_peered":"2024-09-21T01:49:39.353830+0000","last_unstale":"2024-09-21T01:49:41.736394+0000","last_undegraded":"2024-09-21T01:49:41.736394+0000","last_fullsized":"2024-09-21T01:49:41.736394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:15.388595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353615+0000","last_change":"2024-09-21T01:49:40.351596+0000","last_active":"2024-09-21T01:49:41.353615+0000","last_peered":"2024-09-21T01:49:41.353615+0000","last_clean":"2024-09-21T01:49:41.353615+0000","last_became_active":"2024-09-21T01:49:40.350101+0000","last_became_peered":"2024-09-21T01:49:40.350101+0000","last_unstale":"2024-09-21T01:49:41.353615+0000","last_undegraded":"2024-09-21T01:49:41.353615+0000","last_fullsized":"2024-09-21T01:49:41.353615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:48.287340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535256+0000","last_change":"2024-09-21T01:49:39.347072+0000","last_active":"2024-09-21T01:49:41.535256+0000","last_peered":"2024-09-21T01:49:41.535256+0000","last_clean":"2024-09-21T01:49:41.535256+0000","last_became_active":"2024-09-21T01:49:39.346726+0000","last_became_peered":"2024-09-21T01:49:39.346726+0000","last_unstale":"2024-09-21T01:49:41.535256+0000","last_undegraded":"2024-09-21T01:49:41.535256+0000","last_fullsized":"2024-09-21T01:49:41.535256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:47.281134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737098+0000","last_change":"2024-09-21T01:49:40.361933+0000","last_active":"2024-09-21T01:49:41.737098+0000","last_peered":"2024-09-21T01:49:41.737098+0000","last_clean":"2024-09-21T01:49:41.737098+0000","last_became_active":"2024-09-21T01:49:40.361599+0000","last_became_peered":"2024-09-21T01:49:40.361599+0000","last_unstale":"2024-09-21T01:49:41.737098+0000","last_undegraded":"2024-09-21T01:49:41.737098+0000","last_fullsized":"2024-09-21T01:49:41.737098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:14.949645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351000+0000","last_change":"2024-09-21T01:49:39.352696+0000","last_active":"2024-09-21T01:49:41.351000+0000","last_peered":"2024-09-21T01:49:41.351000+0000","last_clean":"2024-09-21T01:49:41.351000+0000","last_became_active":"2024-09-21T01:49:39.352336+0000","last_became_peered":"2024-09-21T01:49:39.352336+0000","last_unstale":"2024-09-21T01:49:41.351000+0000","last_undegraded":"2024-09-21T01:49:41.351000+0000","last_fullsized":"2024-09-21T01:49:41.351000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:43.205610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350554+0000","last_change":"2024-09-21T01:49:40.349301+0000","last_active":"2024-09-21T01:49:41.350554+0000","last_peered":"2024-09-21T01:49:41.350554+0000","last_clean":"2024-09-21T01:49:41.350554+0000","last_became_active":"2024-09-21T01:49:40.348932+0000","last_became_peered":"2024-09-21T01:49:40.348932+0000","last_unstale":"2024-09-21T01:49:41.350554+0000","last_undegraded":"2024-09-21T01:49:41.350554+0000","last_fullsized":"2024-09-21T01:49:41.350554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:26.393817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737256+0000","last_change":"2024-09-21T01:49:39.354615+0000","last_active":"2024-09-21T01:49:41.737256+0000","last_peered":"2024-09-21T01:49:41.737256+0000","last_clean":"2024-09-21T01:49:41.737256+0000","last_became_active":"2024-09-21T01:49:39.354155+0000","last_became_peered":"2024-09-21T01:49:39.354155+0000","last_unstale":"2024-09-21T01:49:41.737256+0000","last_undegraded":"2024-09-21T01:49:41.737256+0000","last_fullsized":"2024-09-21T01:49:41.737256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:17.741128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737707+0000","last_change":"2024-09-21T01:49:40.358953+0000","last_active":"2024-09-21T01:49:41.737707+0000","last_peered":"2024-09-21T01:49:41.737707+0000","last_clean":"2024-09-21T01:49:41.737707+0000","last_became_active":"2024-09-21T01:49:40.358659+0000","last_became_peered":"2024-09-21T01:49:40.358659+0000","last_unstale":"2024-09-21T01:49:41.737707+0000","last_undegraded":"2024-09-21T01:49:41.737707+0000","last_fullsized":"2024-09-21T01:49:41.737707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.223285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535008+0000","last_change":"2024-09-21T01:49:39.344739+0000","last_active":"2024-09-21T01:49:41.535008+0000","last_peered":"2024-09-21T01:49:41.535008+0000","last_clean":"2024-09-21T01:49:41.535008+0000","last_became_active":"2024-09-21T01:49:39.344397+0000","last_became_peered":"2024-09-21T01:49:39.344397+0000","last_unstale":"2024-09-21T01:49:41.535008+0000","last_undegraded":"2024-09-21T01:49:41.535008+0000","last_fullsized":"2024-09-21T01:49:41.535008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:27.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535220+0000","last_change":"2024-09-21T01:49:40.364133+0000","last_active":"2024-09-21T01:49:41.535220+0000","last_peered":"2024-09-21T01:49:41.535220+0000","last_clean":"2024-09-21T01:49:41.535220+0000","last_became_active":"2024-09-21T01:49:40.363324+0000","last_became_peered":"2024-09-21T01:49:40.363324+0000","last_unstale":"2024-09-21T01:49:41.535220+0000","last_undegraded":"2024-09-21T01:49:41.535220+0000","last_fullsized":"2024-09-21T01:49:41.535220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:47.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735791+0000","last_change":"2024-09-21T01:49:39.352951+0000","last_active":"2024-09-21T01:49:41.735791+0000","last_peered":"2024-09-21T01:49:41.735791+0000","last_clean":"2024-09-21T01:49:41.735791+0000","last_became_active":"2024-09-21T01:49:39.352592+0000","last_became_peered":"2024-09-21T01:49:39.352592+0000","last_unstale":"2024-09-21T01:49:41.735791+0000","last_undegraded":"2024-09-21T01:49:41.735791+0000","last_fullsized":"2024-09-21T01:49:41.735791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:21.017265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737020+0000","last_change":"2024-09-21T01:49:40.356971+0000","last_active":"2024-09-21T01:49:41.737020+0000","last_peered":"2024-09-21T01:49:41.737020+0000","last_clean":"2024-09-21T01:49:41.737020+0000","last_became_active":"2024-09-21T01:49:40.356575+0000","last_became_peered":"2024-09-21T01:49:40.356575+0000","last_unstale":"2024-09-21T01:49:41.737020+0000","last_undegraded":"2024-09-21T01:49:41.737020+0000","last_fullsized":"2024-09-21T01:49:41.737020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:00.866709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353420+0000","last_change":"2024-09-21T01:49:39.350322+0000","last_active":"2024-09-21T01:49:41.353420+0000","last_peered":"2024-09-21T01:49:41.353420+0000","last_clean":"2024-09-21T01:49:41.353420+0000","last_became_active":"2024-09-21T01:49:39.349770+0000","last_became_peered":"2024-09-21T01:49:39.349770+0000","last_unstale":"2024-09-21T01:49:41.353420+0000","last_undegraded":"2024-09-21T01:49:41.353420+0000","last_fullsized":"2024-09-21T01:49:41.353420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:26.105437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737557+0000","last_change":"2024-09-21T01:49:40.364278+0000","last_active":"2024-09-21T01:49:41.737557+0000","last_peered":"2024-09-21T01:49:41.737557+0000","last_clean":"2024-09-21T01:49:41.737557+0000","last_became_active":"2024-09-21T01:49:40.363949+0000","last_became_peered":"2024-09-21T01:49:40.363949+0000","last_unstale":"2024-09-21T01:49:41.737557+0000","last_undegraded":"2024-09-21T01:49:41.737557+0000","last_fullsized":"2024-09-21T01:49:41.737557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:45.719101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736424+0000","last_change":"2024-09-21T01:49:39.346299+0000","last_active":"2024-09-21T01:49:41.736424+0000","last_peered":"2024-09-21T01:49:41.736424+0000","last_clean":"2024-09-21T01:49:41.736424+0000","last_became_active":"2024-09-21T01:49:39.345944+0000","last_became_peered":"2024-09-21T01:49:39.345944+0000","last_unstale":"2024-09-21T01:49:41.736424+0000","last_undegraded":"2024-09-21T01:49:41.736424+0000","last_fullsized":"2024-09-21T01:49:41.736424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:19.582036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.738129+0000","last_change":"2024-09-21T01:49:40.364893+0000","last_active":"2024-09-21T01:49:41.738129+0000","last_peered":"2024-09-21T01:49:41.738129+0000","last_clean":"2024-09-21T01:49:41.738129+0000","last_became_active":"2024-09-21T01:49:40.364145+0000","last_became_peered":"2024-09-21T01:49:40.364145+0000","last_unstale":"2024-09-21T01:49:41.738129+0000","last_undegraded":"2024-09-21T01:49:41.738129+0000","last_fullsized":"2024-09-21T01:49:41.738129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:03.444824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736525+0000","last_change":"2024-09-21T01:49:39.341903+0000","last_active":"2024-09-21T01:49:41.736525+0000","last_peered":"2024-09-21T01:49:41.736525+0000","last_clean":"2024-09-21T01:49:41.736525+0000","last_became_active":"2024-09-21T01:49:39.339820+0000","last_became_peered":"2024-09-21T01:49:39.339820+0000","last_unstale":"2024-09-21T01:49:41.736525+0000","last_undegraded":"2024-09-21T01:49:41.736525+0000","last_fullsized":"2024-09-21T01:49:41.736525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:09.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737057+0000","last_change":"2024-09-21T01:49:40.371573+0000","last_active":"2024-09-21T01:49:41.737057+0000","last_peered":"2024-09-21T01:49:41.737057+0000","last_clean":"2024-09-21T01:49:41.737057+0000","last_became_active":"2024-09-21T01:49:40.371260+0000","last_became_peered":"2024-09-21T01:49:40.371260+0000","last_unstale":"2024-09-21T01:49:41.737057+0000","last_undegraded":"2024-09-21T01:49:41.737057+0000","last_fullsized":"2024-09-21T01:49:41.737057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:52.256418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735984+0000","last_change":"2024-09-21T01:49:39.357807+0000","last_active":"2024-09-21T01:49:41.735984+0000","last_peered":"2024-09-21T01:49:41.735984+0000","last_clean":"2024-09-21T01:49:41.735984+0000","last_became_active":"2024-09-21T01:49:39.357452+0000","last_became_peered":"2024-09-21T01:49:39.357452+0000","last_unstale":"2024-09-21T01:49:41.735984+0000","last_undegraded":"2024-09-21T01:49:41.735984+0000","last_fullsized":"2024-09-21T01:49:41.735984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:13.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737329+0000","last_change":"2024-09-21T01:49:40.361593+0000","last_active":"2024-09-21T01:49:41.737329+0000","last_peered":"2024-09-21T01:49:41.737329+0000","last_clean":"2024-09-21T01:49:41.737329+0000","last_became_active":"2024-09-21T01:49:40.360542+0000","last_became_peered":"2024-09-21T01:49:40.360542+0000","last_unstale":"2024-09-21T01:49:41.737329+0000","last_undegraded":"2024-09-21T01:49:41.737329+0000","last_fullsized":"2024-09-21T01:49:41.737329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:42.329087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736838+0000","last_change":"2024-09-21T01:49:29.995848+0000","last_active":"2024-09-21T01:49:41.736838+0000","last_peered":"2024-09-21T01:49:41.736838+0000","last_clean":"2024-09-21T01:49:41.736838+0000","last_became_active":"2024-09-21T01:49:29.994790+0000","last_became_peered":"2024-09-21T01:49:29.994790+0000","last_unstale":"2024-09-21T01:49:41.736838+0000","last_undegraded":"2024-09-21T01:49:41.736838+0000","last_fullsized":"2024-09-21T01:49:41.736838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_clean_scrub_stamp":"2024-09-21T01:49:28.252238+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:30.318506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736286+0000","last_change":"2024-09-21T01:49:39.356186+0000","last_active":"2024-09-21T01:49:41.736286+0000","last_peered":"2024-09-21T01:49:41.736286+0000","last_clean":"2024-09-21T01:49:41.736286+0000","last_became_active":"2024-09-21T01:49:39.354842+0000","last_became_peered":"2024-09-21T01:49:39.354842+0000","last_unstale":"2024-09-21T01:49:41.736286+0000","last_undegraded":"2024-09-21T01:49:41.736286+0000","last_fullsized":"2024-09-21T01:49:41.736286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352187+0000","last_change":"2024-09-21T01:49:40.363797+0000","last_active":"2024-09-21T01:49:41.352187+0000","last_peered":"2024-09-21T01:49:41.352187+0000","last_clean":"2024-09-21T01:49:41.352187+0000","last_became_active":"2024-09-21T01:49:40.363490+0000","last_became_peered":"2024-09-21T01:49:40.363490+0000","last_unstale":"2024-09-21T01:49:41.352187+0000","last_undegraded":"2024-09-21T01:49:41.352187+0000","last_fullsized":"2024-09-21T01:49:41.352187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:36.062812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736708+0000","last_change":"2024-09-21T01:49:39.356359+0000","last_active":"2024-09-21T01:49:41.736708+0000","last_peered":"2024-09-21T01:49:41.736708+0000","last_clean":"2024-09-21T01:49:41.736708+0000","last_became_active":"2024-09-21T01:49:39.356029+0000","last_became_peered":"2024-09-21T01:49:39.356029+0000","last_unstale":"2024-09-21T01:49:41.736708+0000","last_undegraded":"2024-09-21T01:49:41.736708+0000","last_fullsized":"2024-09-21T01:49:41.736708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:47.281134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350257+0000","last_change":"2024-09-21T01:49:40.346325+0000","last_active":"2024-09-21T01:49:41.350257+0000","last_peered":"2024-09-21T01:49:41.350257+0000","last_clean":"2024-09-21T01:49:41.350257+0000","last_became_active":"2024-09-21T01:49:40.345976+0000","last_became_peered":"2024-09-21T01:49:40.345976+0000","last_unstale":"2024-09-21T01:49:41.350257+0000","last_undegraded":"2024-09-21T01:49:41.350257+0000","last_fullsized":"2024-09-21T01:49:41.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:16.293654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736138+0000","last_change":"2024-09-21T01:49:39.346504+0000","last_active":"2024-09-21T01:49:41.736138+0000","last_peered":"2024-09-21T01:49:41.736138+0000","last_clean":"2024-09-21T01:49:41.736138+0000","last_became_active":"2024-09-21T01:49:39.345964+0000","last_became_peered":"2024-09-21T01:49:39.345964+0000","last_unstale":"2024-09-21T01:49:41.736138+0000","last_undegraded":"2024-09-21T01:49:41.736138+0000","last_fullsized":"2024-09-21T01:49:41.736138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736581+0000","last_change":"2024-09-21T01:49:40.355895+0000","last_active":"2024-09-21T01:49:41.736581+0000","last_peered":"2024-09-21T01:49:41.736581+0000","last_clean":"2024-09-21T01:49:41.736581+0000","last_became_active":"2024-09-21T01:49:40.355565+0000","last_became_peered":"2024-09-21T01:49:40.355565+0000","last_unstale":"2024-09-21T01:49:41.736581+0000","last_undegraded":"2024-09-21T01:49:41.736581+0000","last_fullsized":"2024-09-21T01:49:41.736581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:32.806782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737699+0000","last_change":"2024-09-21T01:49:39.354243+0000","last_active":"2024-09-21T01:49:41.737699+0000","last_peered":"2024-09-21T01:49:41.737699+0000","last_clean":"2024-09-21T01:49:41.737699+0000","last_became_active":"2024-09-21T01:49:39.353072+0000","last_became_peered":"2024-09-21T01:49:39.353072+0000","last_unstale":"2024-09-21T01:49:41.737699+0000","last_undegraded":"2024-09-21T01:49:41.737699+0000","last_fullsized":"2024-09-21T01:49:41.737699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:17.764196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353693+0000","last_change":"2024-09-21T01:49:40.352821+0000","last_active":"2024-09-21T01:49:41.353693+0000","last_peered":"2024-09-21T01:49:41.353693+0000","last_clean":"2024-09-21T01:49:41.353693+0000","last_became_active":"2024-09-21T01:49:40.351889+0000","last_became_peered":"2024-09-21T01:49:40.351889+0000","last_unstale":"2024-09-21T01:49:41.353693+0000","last_undegraded":"2024-09-21T01:49:41.353693+0000","last_fullsized":"2024-09-21T01:49:41.353693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:05.023859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736502+0000","last_change":"2024-09-21T01:49:39.351127+0000","last_active":"2024-09-21T01:49:41.736502+0000","last_peered":"2024-09-21T01:49:41.736502+0000","last_clean":"2024-09-21T01:49:41.736502+0000","last_became_active":"2024-09-21T01:49:39.350783+0000","last_became_peered":"2024-09-21T01:49:39.350783+0000","last_unstale":"2024-09-21T01:49:41.736502+0000","last_undegraded":"2024-09-21T01:49:41.736502+0000","last_fullsized":"2024-09-21T01:49:41.736502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:42.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737434+0000","last_change":"2024-09-21T01:49:40.368882+0000","last_active":"2024-09-21T01:49:41.737434+0000","last_peered":"2024-09-21T01:49:41.737434+0000","last_clean":"2024-09-21T01:49:41.737434+0000","last_became_active":"2024-09-21T01:49:40.367820+0000","last_became_peered":"2024-09-21T01:49:40.367820+0000","last_unstale":"2024-09-21T01:49:41.737434+0000","last_undegraded":"2024-09-21T01:49:41.737434+0000","last_fullsized":"2024-09-21T01:49:41.737434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:45.001295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737894+0000","last_change":"2024-09-21T01:49:39.356508+0000","last_active":"2024-09-21T01:49:41.737894+0000","last_peered":"2024-09-21T01:49:41.737894+0000","last_clean":"2024-09-21T01:49:41.737894+0000","last_became_active":"2024-09-21T01:49:39.356169+0000","last_became_peered":"2024-09-21T01:49:39.356169+0000","last_unstale":"2024-09-21T01:49:41.737894+0000","last_undegraded":"2024-09-21T01:49:41.737894+0000","last_fullsized":"2024-09-21T01:49:41.737894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:52.672165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736513+0000","last_change":"2024-09-21T01:49:40.351790+0000","last_active":"2024-09-21T01:49:41.736513+0000","last_peered":"2024-09-21T01:49:41.736513+0000","last_clean":"2024-09-21T01:49:41.736513+0000","last_became_active":"2024-09-21T01:49:40.351392+0000","last_became_peered":"2024-09-21T01:49:40.351392+0000","last_unstale":"2024-09-21T01:49:41.736513+0000","last_undegraded":"2024-09-21T01:49:41.736513+0000","last_fullsized":"2024-09-21T01:49:41.736513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:45.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:42.340972+0000","last_change":"2024-09-21T01:49:39.353294+0000","last_active":"2024-09-21T01:49:42.340972+0000","last_peered":"2024-09-21T01:49:42.340972+0000","last_clean":"2024-09-21T01:49:42.340972+0000","last_became_active":"2024-09-21T01:49:39.352984+0000","last_became_peered":"2024-09-21T01:49:39.352984+0000","last_unstale":"2024-09-21T01:49:42.340972+0000","last_undegraded":"2024-09-21T01:49:42.340972+0000","last_fullsized":"2024-09-21T01:49:42.340972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:31.319877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351908+0000","last_change":"2024-09-21T01:49:40.351451+0000","last_active":"2024-09-21T01:49:41.351908+0000","last_peered":"2024-09-21T01:49:41.351908+0000","last_clean":"2024-09-21T01:49:41.351908+0000","last_became_active":"2024-09-21T01:49:40.351100+0000","last_became_peered":"2024-09-21T01:49:40.351100+0000","last_unstale":"2024-09-21T01:49:41.351908+0000","last_undegraded":"2024-09-21T01:49:41.351908+0000","last_fullsized":"2024-09-21T01:49:41.351908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:15.787679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535436+0000","last_change":"2024-09-21T01:49:39.353205+0000","last_active":"2024-09-21T01:49:41.535436+0000","last_peered":"2024-09-21T01:49:41.535436+0000","last_clean":"2024-09-21T01:49:41.535436+0000","last_became_active":"2024-09-21T01:49:39.352858+0000","last_became_peered":"2024-09-21T01:49:39.352858+0000","last_unstale":"2024-09-21T01:49:41.535436+0000","last_undegraded":"2024-09-21T01:49:41.535436+0000","last_fullsized":"2024-09-21T01:49:41.535436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:35.086866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350768+0000","last_change":"2024-09-21T01:49:40.354056+0000","last_active":"2024-09-21T01:49:41.350768+0000","last_peered":"2024-09-21T01:49:41.350768+0000","last_clean":"2024-09-21T01:49:41.350768+0000","last_became_active":"2024-09-21T01:49:40.353701+0000","last_became_peered":"2024-09-21T01:49:40.353701+0000","last_unstale":"2024-09-21T01:49:41.350768+0000","last_undegraded":"2024-09-21T01:49:41.350768+0000","last_fullsized":"2024-09-21T01:49:41.350768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:36.817174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736561+0000","last_change":"2024-09-21T01:49:39.355387+0000","last_active":"2024-09-21T01:49:41.736561+0000","last_peered":"2024-09-21T01:49:41.736561+0000","last_clean":"2024-09-21T01:49:41.736561+0000","last_became_active":"2024-09-21T01:49:39.355048+0000","last_became_peered":"2024-09-21T01:49:39.355048+0000","last_unstale":"2024-09-21T01:49:41.736561+0000","last_undegraded":"2024-09-21T01:49:41.736561+0000","last_fullsized":"2024-09-21T01:49:41.736561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:27.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353474+0000","last_change":"2024-09-21T01:49:40.351959+0000","last_active":"2024-09-21T01:49:41.353474+0000","last_peered":"2024-09-21T01:49:41.353474+0000","last_clean":"2024-09-21T01:49:41.353474+0000","last_became_active":"2024-09-21T01:49:40.351308+0000","last_became_peered":"2024-09-21T01:49:40.351308+0000","last_unstale":"2024-09-21T01:49:41.353474+0000","last_undegraded":"2024-09-21T01:49:41.353474+0000","last_fullsized":"2024-09-21T01:49:41.353474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:28.397512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736277+0000","last_change":"2024-09-21T01:49:39.350179+0000","last_active":"2024-09-21T01:49:41.736277+0000","last_peered":"2024-09-21T01:49:41.736277+0000","last_clean":"2024-09-21T01:49:41.736277+0000","last_became_active":"2024-09-21T01:49:39.347968+0000","last_became_peered":"2024-09-21T01:49:39.347968+0000","last_unstale":"2024-09-21T01:49:41.736277+0000","last_undegraded":"2024-09-21T01:49:41.736277+0000","last_fullsized":"2024-09-21T01:49:41.736277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352083+0000","last_change":"2024-09-21T01:49:40.354991+0000","last_active":"2024-09-21T01:49:41.352083+0000","last_peered":"2024-09-21T01:49:41.352083+0000","last_clean":"2024-09-21T01:49:41.352083+0000","last_became_active":"2024-09-21T01:49:40.352773+0000","last_became_peered":"2024-09-21T01:49:40.352773+0000","last_unstale":"2024-09-21T01:49:41.352083+0000","last_undegraded":"2024-09-21T01:49:41.352083+0000","last_fullsized":"2024-09-21T01:49:41.352083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:26.545436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736233+0000","last_change":"2024-09-21T01:49:39.349158+0000","last_active":"2024-09-21T01:49:41.736233+0000","last_peered":"2024-09-21T01:49:41.736233+0000","last_clean":"2024-09-21T01:49:41.736233+0000","last_became_active":"2024-09-21T01:49:39.347821+0000","last_became_peered":"2024-09-21T01:49:39.347821+0000","last_unstale":"2024-09-21T01:49:41.736233+0000","last_undegraded":"2024-09-21T01:49:41.736233+0000","last_fullsized":"2024-09-21T01:49:41.736233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:02.187963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352318+0000","last_change":"2024-09-21T01:49:40.355562+0000","last_active":"2024-09-21T01:49:41.352318+0000","last_peered":"2024-09-21T01:49:41.352318+0000","last_clean":"2024-09-21T01:49:41.352318+0000","last_became_active":"2024-09-21T01:49:40.354546+0000","last_became_peered":"2024-09-21T01:49:40.354546+0000","last_unstale":"2024-09-21T01:49:41.352318+0000","last_undegraded":"2024-09-21T01:49:41.352318+0000","last_fullsized":"2024-09-21T01:49:41.352318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:52.645109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737751+0000","last_change":"2024-09-21T01:49:39.358033+0000","last_active":"2024-09-21T01:49:41.737751+0000","last_peered":"2024-09-21T01:49:41.737751+0000","last_clean":"2024-09-21T01:49:41.737751+0000","last_became_active":"2024-09-21T01:49:39.357680+0000","last_became_peered":"2024-09-21T01:49:39.357680+0000","last_unstale":"2024-09-21T01:49:41.737751+0000","last_undegraded":"2024-09-21T01:49:41.737751+0000","last_fullsized":"2024-09-21T01:49:41.737751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:09:19.831260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535186+0000","last_change":"2024-09-21T01:49:40.365613+0000","last_active":"2024-09-21T01:49:41.535186+0000","last_peered":"2024-09-21T01:49:41.535186+0000","last_clean":"2024-09-21T01:49:41.535186+0000","last_became_active":"2024-09-21T01:49:40.365297+0000","last_became_peered":"2024-09-21T01:49:40.365297+0000","last_unstale":"2024-09-21T01:49:41.535186+0000","last_undegraded":"2024-09-21T01:49:41.535186+0000","last_fullsized":"2024-09-21T01:49:41.535186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.999168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736952+0000","last_change":"2024-09-21T01:49:40.367268+0000","last_active":"2024-09-21T01:49:41.736952+0000","last_peered":"2024-09-21T01:49:41.736952+0000","last_clean":"2024-09-21T01:49:41.736952+0000","last_became_active":"2024-09-21T01:49:40.366946+0000","last_became_peered":"2024-09-21T01:49:40.366946+0000","last_unstale":"2024-09-21T01:49:41.736952+0000","last_undegraded":"2024-09-21T01:49:41.736952+0000","last_fullsized":"2024-09-21T01:49:41.736952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:29.301249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736693+0000","last_change":"2024-09-21T01:49:39.359266+0000","last_active":"2024-09-21T01:49:41.736693+0000","last_peered":"2024-09-21T01:49:41.736693+0000","last_clean":"2024-09-21T01:49:41.736693+0000","last_became_active":"2024-09-21T01:49:39.358350+0000","last_became_peered":"2024-09-21T01:49:39.358350+0000","last_unstale":"2024-09-21T01:49:41.736693+0000","last_undegraded":"2024-09-21T01:49:41.736693+0000","last_fullsized":"2024-09-21T01:49:41.736693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:43.979023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737278+0000","last_change":"2024-09-21T01:49:40.367875+0000","last_active":"2024-09-21T01:49:41.737278+0000","last_peered":"2024-09-21T01:49:41.737278+0000","last_clean":"2024-09-21T01:49:41.737278+0000","last_became_active":"2024-09-21T01:49:40.367529+0000","last_became_peered":"2024-09-21T01:49:40.367529+0000","last_unstale":"2024-09-21T01:49:41.737278+0000","last_undegraded":"2024-09-21T01:49:41.737278+0000","last_fullsized":"2024-09-21T01:49:41.737278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:17.573511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737423+0000","last_change":"2024-09-21T01:49:39.359628+0000","last_active":"2024-09-21T01:49:41.737423+0000","last_peered":"2024-09-21T01:49:41.737423+0000","last_clean":"2024-09-21T01:49:41.737423+0000","last_became_active":"2024-09-21T01:49:39.359209+0000","last_became_peered":"2024-09-21T01:49:39.359209+0000","last_unstale":"2024-09-21T01:49:41.737423+0000","last_undegraded":"2024-09-21T01:49:41.737423+0000","last_fullsized":"2024-09-21T01:49:41.737423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:04.017652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350648+0000","last_change":"2024-09-21T01:49:40.364917+0000","last_active":"2024-09-21T01:49:41.350648+0000","last_peered":"2024-09-21T01:49:41.350648+0000","last_clean":"2024-09-21T01:49:41.350648+0000","last_became_active":"2024-09-21T01:49:40.364166+0000","last_became_peered":"2024-09-21T01:49:40.364166+0000","last_unstale":"2024-09-21T01:49:41.350648+0000","last_undegraded":"2024-09-21T01:49:41.350648+0000","last_fullsized":"2024-09-21T01:49:41.350648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:08.726343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351636+0000","last_change":"2024-09-21T01:49:39.356150+0000","last_active":"2024-09-21T01:49:41.351636+0000","last_peered":"2024-09-21T01:49:41.351636+0000","last_clean":"2024-09-21T01:49:41.351636+0000","last_became_active":"2024-09-21T01:49:39.355548+0000","last_became_peered":"2024-09-21T01:49:39.355548+0000","last_unstale":"2024-09-21T01:49:41.351636+0000","last_undegraded":"2024-09-21T01:49:41.351636+0000","last_fullsized":"2024-09-21T01:49:41.351636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:02.371670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351655+0000","last_change":"2024-09-21T01:49:40.357471+0000","last_active":"2024-09-21T01:49:41.351655+0000","last_peered":"2024-09-21T01:49:41.351655+0000","last_clean":"2024-09-21T01:49:41.351655+0000","last_became_active":"2024-09-21T01:49:40.357158+0000","last_became_peered":"2024-09-21T01:49:40.357158+0000","last_unstale":"2024-09-21T01:49:41.351655+0000","last_undegraded":"2024-09-21T01:49:41.351655+0000","last_fullsized":"2024-09-21T01:49:41.351655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:22:28.048336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350824+0000","last_change":"2024-09-21T01:49:39.354483+0000","last_active":"2024-09-21T01:49:41.350824+0000","last_peered":"2024-09-21T01:49:41.350824+0000","last_clean":"2024-09-21T01:49:41.350824+0000","last_became_active":"2024-09-21T01:49:39.354167+0000","last_became_peered":"2024-09-21T01:49:39.354167+0000","last_unstale":"2024-09-21T01:49:41.350824+0000","last_undegraded":"2024-09-21T01:49:41.350824+0000","last_fullsized":"2024-09-21T01:49:41.350824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:08:48.875745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":662973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:49:52.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:49:52.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.332+0000 7fd2e8189640 1 -- 172.21.15.40:0/2454392671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e00b55b0 msgr2=0x7fd2e01662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.332+0000 7fd2e8189640 1 --2- 172.21.15.40:0/2454392671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e00b55b0 0x7fd2e01662c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0005fd0 tx=0x7fd2d002a940 comp rx=0 tx=0).stop 2024-09-21T01:49:52.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.332+0000 7fd2e8189640 1 -- 172.21.15.40:0/2454392671 shutdown_connections 2024-09-21T01:49:52.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.332+0000 7fd2e8189640 1 --2- 172.21.15.40:0/2454392671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e00b55b0 0x7fd2e01662c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.332+0000 7fd2e8189640 1 -- 172.21.15.40:0/2454392671 >> 172.21.15.40:0/2454392671 conn(0x7fd2e006def0 msgr2=0x7fd2e006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:52.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.332+0000 7fd2e8189640 1 -- 172.21.15.40:0/2454392671 shutdown_connections 2024-09-21T01:49:52.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.332+0000 7fd2e8189640 1 -- 172.21.15.40:0/2454392671 wait complete. 2024-09-21T01:49:52.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.334+0000 7fd2e8189640 1 Processor -- start 2024-09-21T01:49:52.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.334+0000 7fd2e8189640 1 -- start start 2024-09-21T01:49:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.335+0000 7fd2e8189640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2e0074420 0x7fd2e0154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.335+0000 7fd2e8189640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2e00b55b0 0x7fd2e0150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.335+0000 7fd2e8189640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e01514d0 0x7fd2e00b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.335+0000 7fd2e8189640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0166b90 con 0x7fd2e01514d0 2024-09-21T01:49:52.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.335+0000 7fd2e8189640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0166a10 con 0x7fd2e00b55b0 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.335+0000 7fd2e8189640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e0166d10 con 0x7fd2e0074420 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e6726640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e01514d0 0x7fd2e00b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e6726640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e01514d0 0x7fd2e00b1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33478/0 (socket says 172.21.15.40:33478) 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e6726640 1 -- 172.21.15.40:0/924387032 learned_addr learned my addr 172.21.15.40:0/924387032 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e5724640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2e00b55b0 0x7fd2e0150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e5f25640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2e0074420 0x7fd2e0154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e6726640 1 -- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2e0074420 msgr2=0x7fd2e0154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e6726640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2e0074420 0x7fd2e0154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e6726640 1 -- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2e00b55b0 msgr2=0x7fd2e0150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e6726640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2e00b55b0 0x7fd2e0150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e6726640 1 -- 172.21.15.40:0/924387032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e0151a80 con 0x7fd2e01514d0 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e6726640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e01514d0 0x7fd2e00b1930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002af30 tx=0x7fd2d0031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:52.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2de7fc640 1 -- 172.21.15.40:0/924387032 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d003e070 con 0x7fd2e01514d0 2024-09-21T01:49:52.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2de7fc640 1 -- 172.21.15.40:0/924387032 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2d0004560 con 0x7fd2e01514d0 2024-09-21T01:49:52.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2de7fc640 1 -- 172.21.15.40:0/924387032 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0043460 con 0x7fd2e01514d0 2024-09-21T01:49:52.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e0151d20 con 0x7fd2e01514d0 2024-09-21T01:49:52.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.336+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e0153e50 con 0x7fd2e01514d0 2024-09-21T01:49:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.337+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e015c580 con 0x7fd2e01514d0 2024-09-21T01:49:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.338+0000 7fd2de7fc640 1 -- 172.21.15.40:0/924387032 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2d003a440 con 0x7fd2e01514d0 2024-09-21T01:49:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.339+0000 7fd2de7fc640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd2cc078b90 0x7fd2cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.339+0000 7fd2de7fc640 1 -- 172.21.15.40:0/924387032 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd2d00bc960 con 0x7fd2e01514d0 2024-09-21T01:49:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.339+0000 7fd2e5f25640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd2cc078b90 0x7fd2cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:52.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.339+0000 7fd2e5f25640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd2cc078b90 0x7fd2cc07b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8001720 tx=0x7fd2d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:52.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.343+0000 7fd2de7fc640 1 -- 172.21.15.40:0/924387032 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd2d00846b0 con 0x7fd2e01514d0 2024-09-21T01:49:52.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.530+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 --> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2e015b260 con 0x7fd2cc078b90 2024-09-21T01:49:52.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.534+0000 7fd2de7fc640 1 -- 172.21.15.40:0/924387032 <== mgr.4100 v2:172.21.15.139:6800/852736644 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7fd2e015b260 con 0x7fd2cc078b90 2024-09-21T01:49:52.538 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:52.540 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-21T01:49:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd2cc078b90 msgr2=0x7fd2cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd2cc078b90 0x7fd2cc07b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8001720 tx=0x7fd2d8009040 comp rx=0 tx=0).stop 2024-09-21T01:49:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e01514d0 msgr2=0x7fd2e00b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e01514d0 0x7fd2e00b1930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002af30 tx=0x7fd2d0031ea0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 shutdown_connections 2024-09-21T01:49:52.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd2cc078b90 0x7fd2cc07b0a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2e01514d0 0x7fd2e00b1930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2e00b55b0 0x7fd2e0150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 --2- 172.21.15.40:0/924387032 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd2e0074420 0x7fd2e0154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 >> 172.21.15.40:0/924387032 conn(0x7fd2e006def0 msgr2=0x7fd2e006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 shutdown_connections 2024-09-21T01:49:52.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.538+0000 7fd2e8189640 1 -- 172.21.15.40:0/924387032 wait complete. 2024-09-21T01:49:52.550 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-21T01:49:51.312037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2924544,"data_stored":1761292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003073"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737960+0000","last_change":"2024-09-21T01:49:40.356030+0000","last_active":"2024-09-21T01:49:41.737960+0000","last_peered":"2024-09-21T01:49:41.737960+0000","last_clean":"2024-09-21T01:49:41.737960+0000","last_became_active":"2024-09-21T01:49:40.355677+0000","last_became_peered":"2024-09-21T01:49:40.355677+0000","last_unstale":"2024-09-21T01:49:41.737960+0000","last_undegraded":"2024-09-21T01:49:41.737960+0000","last_fullsized":"2024-09-21T01:49:41.737960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:57.340502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736421+0000","last_change":"2024-09-21T01:49:40.366361+0000","last_active":"2024-09-21T01:49:41.736421+0000","last_peered":"2024-09-21T01:49:41.736421+0000","last_clean":"2024-09-21T01:49:41.736421+0000","last_became_active":"2024-09-21T01:49:40.366008+0000","last_became_peered":"2024-09-21T01:49:40.366008+0000","last_unstale":"2024-09-21T01:49:41.736421+0000","last_undegraded":"2024-09-21T01:49:41.736421+0000","last_fullsized":"2024-09-21T01:49:41.736421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:18:30.129619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350613+0000","last_change":"2024-09-21T01:49:40.349571+0000","last_active":"2024-09-21T01:49:41.350613+0000","last_peered":"2024-09-21T01:49:41.350613+0000","last_clean":"2024-09-21T01:49:41.350613+0000","last_became_active":"2024-09-21T01:49:40.349241+0000","last_became_peered":"2024-09-21T01:49:40.349241+0000","last_unstale":"2024-09-21T01:49:41.350613+0000","last_undegraded":"2024-09-21T01:49:41.350613+0000","last_fullsized":"2024-09-21T01:49:41.350613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.999168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736794+0000","last_change":"2024-09-21T01:49:40.372236+0000","last_active":"2024-09-21T01:49:41.736794+0000","last_peered":"2024-09-21T01:49:41.736794+0000","last_clean":"2024-09-21T01:49:41.736794+0000","last_became_active":"2024-09-21T01:49:40.371944+0000","last_became_peered":"2024-09-21T01:49:40.371944+0000","last_unstale":"2024-09-21T01:49:41.736794+0000","last_undegraded":"2024-09-21T01:49:41.736794+0000","last_fullsized":"2024-09-21T01:49:41.736794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:26.563781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737255+0000","last_change":"2024-09-21T01:49:40.358244+0000","last_active":"2024-09-21T01:49:41.737255+0000","last_peered":"2024-09-21T01:49:41.737255+0000","last_clean":"2024-09-21T01:49:41.737255+0000","last_became_active":"2024-09-21T01:49:40.357953+0000","last_became_peered":"2024-09-21T01:49:40.357953+0000","last_unstale":"2024-09-21T01:49:41.737255+0000","last_undegraded":"2024-09-21T01:49:41.737255+0000","last_fullsized":"2024-09-21T01:49:41.737255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:52.645109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736458+0000","last_change":"2024-09-21T01:49:40.370563+0000","last_active":"2024-09-21T01:49:41.736458+0000","last_peered":"2024-09-21T01:49:41.736458+0000","last_clean":"2024-09-21T01:49:41.736458+0000","last_became_active":"2024-09-21T01:49:40.369831+0000","last_became_peered":"2024-09-21T01:49:40.369831+0000","last_unstale":"2024-09-21T01:49:41.736458+0000","last_undegraded":"2024-09-21T01:49:41.736458+0000","last_fullsized":"2024-09-21T01:49:41.736458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736598+0000","last_change":"2024-09-21T01:49:40.364668+0000","last_active":"2024-09-21T01:49:41.736598+0000","last_peered":"2024-09-21T01:49:41.736598+0000","last_clean":"2024-09-21T01:49:41.736598+0000","last_became_active":"2024-09-21T01:49:40.363159+0000","last_became_peered":"2024-09-21T01:49:40.363159+0000","last_unstale":"2024-09-21T01:49:41.736598+0000","last_undegraded":"2024-09-21T01:49:41.736598+0000","last_fullsized":"2024-09-21T01:49:41.736598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:36.062812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351404+0000","last_change":"2024-09-21T01:49:40.363639+0000","last_active":"2024-09-21T01:49:41.351404+0000","last_peered":"2024-09-21T01:49:41.351404+0000","last_clean":"2024-09-21T01:49:41.351404+0000","last_became_active":"2024-09-21T01:49:40.363291+0000","last_became_peered":"2024-09-21T01:49:40.363291+0000","last_unstale":"2024-09-21T01:49:41.351404+0000","last_undegraded":"2024-09-21T01:49:41.351404+0000","last_fullsized":"2024-09-21T01:49:41.351404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:03.841294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737999+0000","last_change":"2024-09-21T01:49:40.366167+0000","last_active":"2024-09-21T01:49:41.737999+0000","last_peered":"2024-09-21T01:49:41.737999+0000","last_clean":"2024-09-21T01:49:41.737999+0000","last_became_active":"2024-09-21T01:49:40.364598+0000","last_became_peered":"2024-09-21T01:49:40.364598+0000","last_unstale":"2024-09-21T01:49:41.737999+0000","last_undegraded":"2024-09-21T01:49:41.737999+0000","last_fullsized":"2024-09-21T01:49:41.737999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:36.012884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535590+0000","last_change":"2024-09-21T01:49:40.368687+0000","last_active":"2024-09-21T01:49:41.535590+0000","last_peered":"2024-09-21T01:49:41.535590+0000","last_clean":"2024-09-21T01:49:41.535590+0000","last_became_active":"2024-09-21T01:49:40.366584+0000","last_became_peered":"2024-09-21T01:49:40.366584+0000","last_unstale":"2024-09-21T01:49:41.535590+0000","last_undegraded":"2024-09-21T01:49:41.535590+0000","last_fullsized":"2024-09-21T01:49:41.535590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535321+0000","last_change":"2024-09-21T01:49:40.358569+0000","last_active":"2024-09-21T01:49:41.535321+0000","last_peered":"2024-09-21T01:49:41.535321+0000","last_clean":"2024-09-21T01:49:41.535321+0000","last_became_active":"2024-09-21T01:49:40.358189+0000","last_became_peered":"2024-09-21T01:49:40.358189+0000","last_unstale":"2024-09-21T01:49:41.535321+0000","last_undegraded":"2024-09-21T01:49:41.535321+0000","last_fullsized":"2024-09-21T01:49:41.535321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:25:54.668625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353509+0000","last_change":"2024-09-21T01:49:40.360227+0000","last_active":"2024-09-21T01:49:41.353509+0000","last_peered":"2024-09-21T01:49:41.353509+0000","last_clean":"2024-09-21T01:49:41.353509+0000","last_became_active":"2024-09-21T01:49:40.359457+0000","last_became_peered":"2024-09-21T01:49:40.359457+0000","last_unstale":"2024-09-21T01:49:41.353509+0000","last_undegraded":"2024-09-21T01:49:41.353509+0000","last_fullsized":"2024-09-21T01:49:41.353509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:44.985230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352280+0000","last_change":"2024-09-21T01:49:40.356310+0000","last_active":"2024-09-21T01:49:41.352280+0000","last_peered":"2024-09-21T01:49:41.352280+0000","last_clean":"2024-09-21T01:49:41.352280+0000","last_became_active":"2024-09-21T01:49:40.356004+0000","last_became_peered":"2024-09-21T01:49:40.356004+0000","last_unstale":"2024-09-21T01:49:41.352280+0000","last_undegraded":"2024-09-21T01:49:41.352280+0000","last_fullsized":"2024-09-21T01:49:41.352280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:14.949645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350350+0000","last_change":"2024-09-21T01:49:40.354886+0000","last_active":"2024-09-21T01:49:41.350350+0000","last_peered":"2024-09-21T01:49:41.350350+0000","last_clean":"2024-09-21T01:49:41.350350+0000","last_became_active":"2024-09-21T01:49:40.354489+0000","last_became_peered":"2024-09-21T01:49:40.354489+0000","last_unstale":"2024-09-21T01:49:41.350350+0000","last_undegraded":"2024-09-21T01:49:41.350350+0000","last_fullsized":"2024-09-21T01:49:41.350350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:43.940906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736359+0000","last_change":"2024-09-21T01:49:40.364466+0000","last_active":"2024-09-21T01:49:41.736359+0000","last_peered":"2024-09-21T01:49:41.736359+0000","last_clean":"2024-09-21T01:49:41.736359+0000","last_became_active":"2024-09-21T01:49:40.364098+0000","last_became_peered":"2024-09-21T01:49:40.364098+0000","last_unstale":"2024-09-21T01:49:41.736359+0000","last_undegraded":"2024-09-21T01:49:41.736359+0000","last_fullsized":"2024-09-21T01:49:41.736359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:24.593410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736538+0000","last_change":"2024-09-21T01:49:40.370361+0000","last_active":"2024-09-21T01:49:41.736538+0000","last_peered":"2024-09-21T01:49:41.736538+0000","last_clean":"2024-09-21T01:49:41.736538+0000","last_became_active":"2024-09-21T01:49:40.370046+0000","last_became_peered":"2024-09-21T01:49:40.370046+0000","last_unstale":"2024-09-21T01:49:41.736538+0000","last_undegraded":"2024-09-21T01:49:41.736538+0000","last_fullsized":"2024-09-21T01:49:41.736538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:35.506009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737746+0000","last_change":"2024-09-21T01:49:40.364197+0000","last_active":"2024-09-21T01:49:41.737746+0000","last_peered":"2024-09-21T01:49:41.737746+0000","last_clean":"2024-09-21T01:49:41.737746+0000","last_became_active":"2024-09-21T01:49:40.363906+0000","last_became_peered":"2024-09-21T01:49:40.363906+0000","last_unstale":"2024-09-21T01:49:41.737746+0000","last_undegraded":"2024-09-21T01:49:41.737746+0000","last_fullsized":"2024-09-21T01:49:41.737746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:40.514781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736268+0000","last_change":"2024-09-21T01:49:40.369575+0000","last_active":"2024-09-21T01:49:41.736268+0000","last_peered":"2024-09-21T01:49:41.736268+0000","last_clean":"2024-09-21T01:49:41.736268+0000","last_became_active":"2024-09-21T01:49:40.369160+0000","last_became_peered":"2024-09-21T01:49:40.369160+0000","last_unstale":"2024-09-21T01:49:41.736268+0000","last_undegraded":"2024-09-21T01:49:41.736268+0000","last_fullsized":"2024-09-21T01:49:41.736268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:32.326084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737961+0000","last_change":"2024-09-21T01:49:40.357275+0000","last_active":"2024-09-21T01:49:41.737961+0000","last_peered":"2024-09-21T01:49:41.737961+0000","last_clean":"2024-09-21T01:49:41.737961+0000","last_became_active":"2024-09-21T01:49:40.356956+0000","last_became_peered":"2024-09-21T01:49:40.356956+0000","last_unstale":"2024-09-21T01:49:41.737961+0000","last_undegraded":"2024-09-21T01:49:41.737961+0000","last_fullsized":"2024-09-21T01:49:41.737961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:09.530740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535522+0000","last_change":"2024-09-21T01:49:40.366142+0000","last_active":"2024-09-21T01:49:41.535522+0000","last_peered":"2024-09-21T01:49:41.535522+0000","last_clean":"2024-09-21T01:49:41.535522+0000","last_became_active":"2024-09-21T01:49:40.365863+0000","last_became_peered":"2024-09-21T01:49:40.365863+0000","last_unstale":"2024-09-21T01:49:41.535522+0000","last_undegraded":"2024-09-21T01:49:41.535522+0000","last_fullsized":"2024-09-21T01:49:41.535522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:24.814662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350661+0000","last_change":"2024-09-21T01:49:40.350221+0000","last_active":"2024-09-21T01:49:41.350661+0000","last_peered":"2024-09-21T01:49:41.350661+0000","last_clean":"2024-09-21T01:49:41.350661+0000","last_became_active":"2024-09-21T01:49:40.349898+0000","last_became_peered":"2024-09-21T01:49:40.349898+0000","last_unstale":"2024-09-21T01:49:41.350661+0000","last_undegraded":"2024-09-21T01:49:41.350661+0000","last_fullsized":"2024-09-21T01:49:41.350661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:12.766064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737119+0000","last_change":"2024-09-21T01:49:40.370844+0000","last_active":"2024-09-21T01:49:41.737119+0000","last_peered":"2024-09-21T01:49:41.737119+0000","last_clean":"2024-09-21T01:49:41.737119+0000","last_became_active":"2024-09-21T01:49:40.369354+0000","last_became_peered":"2024-09-21T01:49:40.369354+0000","last_unstale":"2024-09-21T01:49:41.737119+0000","last_undegraded":"2024-09-21T01:49:41.737119+0000","last_fullsized":"2024-09-21T01:49:41.737119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:04.916601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351626+0000","last_change":"2024-09-21T01:49:40.352293+0000","last_active":"2024-09-21T01:49:41.351626+0000","last_peered":"2024-09-21T01:49:41.351626+0000","last_clean":"2024-09-21T01:49:41.351626+0000","last_became_active":"2024-09-21T01:49:40.351973+0000","last_became_peered":"2024-09-21T01:49:40.351973+0000","last_unstale":"2024-09-21T01:49:41.351626+0000","last_undegraded":"2024-09-21T01:49:41.351626+0000","last_fullsized":"2024-09-21T01:49:41.351626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:12.766064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736452+0000","last_change":"2024-09-21T01:49:40.371534+0000","last_active":"2024-09-21T01:49:41.736452+0000","last_peered":"2024-09-21T01:49:41.736452+0000","last_clean":"2024-09-21T01:49:41.736452+0000","last_became_active":"2024-09-21T01:49:40.371235+0000","last_became_peered":"2024-09-21T01:49:40.371235+0000","last_unstale":"2024-09-21T01:49:41.736452+0000","last_undegraded":"2024-09-21T01:49:41.736452+0000","last_fullsized":"2024-09-21T01:49:41.736452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351780+0000","last_change":"2024-09-21T01:49:40.361289+0000","last_active":"2024-09-21T01:49:41.351780+0000","last_peered":"2024-09-21T01:49:41.351780+0000","last_clean":"2024-09-21T01:49:41.351780+0000","last_became_active":"2024-09-21T01:49:40.360952+0000","last_became_peered":"2024-09-21T01:49:40.360952+0000","last_unstale":"2024-09-21T01:49:41.351780+0000","last_undegraded":"2024-09-21T01:49:41.351780+0000","last_fullsized":"2024-09-21T01:49:41.351780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:58.888642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535608+0000","last_change":"2024-09-21T01:49:40.356406+0000","last_active":"2024-09-21T01:49:41.535608+0000","last_peered":"2024-09-21T01:49:41.535608+0000","last_clean":"2024-09-21T01:49:41.535608+0000","last_became_active":"2024-09-21T01:49:40.355941+0000","last_became_peered":"2024-09-21T01:49:40.355941+0000","last_unstale":"2024-09-21T01:49:41.535608+0000","last_undegraded":"2024-09-21T01:49:41.535608+0000","last_fullsized":"2024-09-21T01:49:41.535608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736560+0000","last_change":"2024-09-21T01:49:40.354384+0000","last_active":"2024-09-21T01:49:41.736560+0000","last_peered":"2024-09-21T01:49:41.736560+0000","last_clean":"2024-09-21T01:49:41.736560+0000","last_became_active":"2024-09-21T01:49:40.354065+0000","last_became_peered":"2024-09-21T01:49:40.354065+0000","last_unstale":"2024-09-21T01:49:41.736560+0000","last_undegraded":"2024-09-21T01:49:41.736560+0000","last_fullsized":"2024-09-21T01:49:41.736560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:43.441374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352248+0000","last_change":"2024-09-21T01:49:40.347679+0000","last_active":"2024-09-21T01:49:41.352248+0000","last_peered":"2024-09-21T01:49:41.352248+0000","last_clean":"2024-09-21T01:49:41.352248+0000","last_became_active":"2024-09-21T01:49:40.347302+0000","last_became_peered":"2024-09-21T01:49:40.347302+0000","last_unstale":"2024-09-21T01:49:41.352248+0000","last_undegraded":"2024-09-21T01:49:41.352248+0000","last_fullsized":"2024-09-21T01:49:41.352248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:00.866709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351058+0000","last_change":"2024-09-21T01:49:40.351144+0000","last_active":"2024-09-21T01:49:41.351058+0000","last_peered":"2024-09-21T01:49:41.351058+0000","last_clean":"2024-09-21T01:49:41.351058+0000","last_became_active":"2024-09-21T01:49:40.350778+0000","last_became_peered":"2024-09-21T01:49:40.350778+0000","last_unstale":"2024-09-21T01:49:41.351058+0000","last_undegraded":"2024-09-21T01:49:41.351058+0000","last_fullsized":"2024-09-21T01:49:41.351058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:53:21.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737667+0000","last_change":"2024-09-21T01:49:40.372249+0000","last_active":"2024-09-21T01:49:41.737667+0000","last_peered":"2024-09-21T01:49:41.737667+0000","last_clean":"2024-09-21T01:49:41.737667+0000","last_became_active":"2024-09-21T01:49:40.371920+0000","last_became_peered":"2024-09-21T01:49:40.371920+0000","last_unstale":"2024-09-21T01:49:41.737667+0000","last_undegraded":"2024-09-21T01:49:41.737667+0000","last_fullsized":"2024-09-21T01:49:41.737667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:57.340502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735902+0000","last_change":"2024-09-21T01:49:40.365077+0000","last_active":"2024-09-21T01:49:41.735902+0000","last_peered":"2024-09-21T01:49:41.735902+0000","last_clean":"2024-09-21T01:49:41.735902+0000","last_became_active":"2024-09-21T01:49:40.364475+0000","last_became_peered":"2024-09-21T01:49:40.364475+0000","last_unstale":"2024-09-21T01:49:41.735902+0000","last_undegraded":"2024-09-21T01:49:41.735902+0000","last_fullsized":"2024-09-21T01:49:41.735902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:16.394801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535444+0000","last_change":"2024-09-21T01:49:40.364957+0000","last_active":"2024-09-21T01:49:41.535444+0000","last_peered":"2024-09-21T01:49:41.535444+0000","last_clean":"2024-09-21T01:49:41.535444+0000","last_became_active":"2024-09-21T01:49:40.363773+0000","last_became_peered":"2024-09-21T01:49:40.363773+0000","last_unstale":"2024-09-21T01:49:41.535444+0000","last_undegraded":"2024-09-21T01:49:41.535444+0000","last_fullsized":"2024-09-21T01:49:41.535444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:36.817174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353667+0000","last_change":"2024-09-21T01:49:40.362548+0000","last_active":"2024-09-21T01:49:41.353667+0000","last_peered":"2024-09-21T01:49:41.353667+0000","last_clean":"2024-09-21T01:49:41.353667+0000","last_became_active":"2024-09-21T01:49:40.362006+0000","last_became_peered":"2024-09-21T01:49:40.362006+0000","last_unstale":"2024-09-21T01:49:41.353667+0000","last_undegraded":"2024-09-21T01:49:41.353667+0000","last_fullsized":"2024-09-21T01:49:41.353667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:09:20.837466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352351+0000","last_change":"2024-09-21T01:49:39.354635+0000","last_active":"2024-09-21T01:49:41.352351+0000","last_peered":"2024-09-21T01:49:41.352351+0000","last_clean":"2024-09-21T01:49:41.352351+0000","last_became_active":"2024-09-21T01:49:39.354261+0000","last_became_peered":"2024-09-21T01:49:39.354261+0000","last_unstale":"2024-09-21T01:49:41.352351+0000","last_undegraded":"2024-09-21T01:49:41.352351+0000","last_fullsized":"2024-09-21T01:49:41.352351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:43.205610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350925+0000","last_change":"2024-09-21T01:49:40.356386+0000","last_active":"2024-09-21T01:49:41.350925+0000","last_peered":"2024-09-21T01:49:41.350925+0000","last_clean":"2024-09-21T01:49:41.350925+0000","last_became_active":"2024-09-21T01:49:40.356070+0000","last_became_peered":"2024-09-21T01:49:40.356070+0000","last_unstale":"2024-09-21T01:49:41.350925+0000","last_undegraded":"2024-09-21T01:49:41.350925+0000","last_fullsized":"2024-09-21T01:49:41.350925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:47.959407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535066+0000","last_change":"2024-09-21T01:49:39.345519+0000","last_active":"2024-09-21T01:49:41.535066+0000","last_peered":"2024-09-21T01:49:41.535066+0000","last_clean":"2024-09-21T01:49:41.535066+0000","last_became_active":"2024-09-21T01:49:39.345204+0000","last_became_peered":"2024-09-21T01:49:39.345204+0000","last_unstale":"2024-09-21T01:49:41.535066+0000","last_undegraded":"2024-09-21T01:49:41.535066+0000","last_fullsized":"2024-09-21T01:49:41.535066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:43.979023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351716+0000","last_change":"2024-09-21T01:49:39.348849+0000","last_active":"2024-09-21T01:49:41.351716+0000","last_peered":"2024-09-21T01:49:41.351716+0000","last_clean":"2024-09-21T01:49:41.351716+0000","last_became_active":"2024-09-21T01:49:39.348541+0000","last_became_peered":"2024-09-21T01:49:39.348541+0000","last_unstale":"2024-09-21T01:49:41.351716+0000","last_undegraded":"2024-09-21T01:49:41.351716+0000","last_fullsized":"2024-09-21T01:49:41.351716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:45.215963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351473+0000","last_change":"2024-09-21T01:49:40.357207+0000","last_active":"2024-09-21T01:49:41.351473+0000","last_peered":"2024-09-21T01:49:41.351473+0000","last_clean":"2024-09-21T01:49:41.351473+0000","last_became_active":"2024-09-21T01:49:40.356888+0000","last_became_peered":"2024-09-21T01:49:40.356888+0000","last_unstale":"2024-09-21T01:49:41.351473+0000","last_undegraded":"2024-09-21T01:49:41.351473+0000","last_fullsized":"2024-09-21T01:49:41.351473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:47.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736549+0000","last_change":"2024-09-21T01:49:39.358208+0000","last_active":"2024-09-21T01:49:41.736549+0000","last_peered":"2024-09-21T01:49:41.736549+0000","last_clean":"2024-09-21T01:49:41.736549+0000","last_became_active":"2024-09-21T01:49:39.357751+0000","last_became_peered":"2024-09-21T01:49:39.357751+0000","last_unstale":"2024-09-21T01:49:41.736549+0000","last_undegraded":"2024-09-21T01:49:41.736549+0000","last_fullsized":"2024-09-21T01:49:41.736549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:17.291066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736125+0000","last_change":"2024-09-21T01:49:40.352449+0000","last_active":"2024-09-21T01:49:41.736125+0000","last_peered":"2024-09-21T01:49:41.736125+0000","last_clean":"2024-09-21T01:49:41.736125+0000","last_became_active":"2024-09-21T01:49:40.352149+0000","last_became_peered":"2024-09-21T01:49:40.352149+0000","last_unstale":"2024-09-21T01:49:41.736125+0000","last_undegraded":"2024-09-21T01:49:41.736125+0000","last_fullsized":"2024-09-21T01:49:41.736125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:11.903566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535350+0000","last_change":"2024-09-21T01:49:39.356457+0000","last_active":"2024-09-21T01:49:41.535350+0000","last_peered":"2024-09-21T01:49:41.535350+0000","last_clean":"2024-09-21T01:49:41.535350+0000","last_became_active":"2024-09-21T01:49:39.356087+0000","last_became_peered":"2024-09-21T01:49:39.356087+0000","last_unstale":"2024-09-21T01:49:41.535350+0000","last_undegraded":"2024-09-21T01:49:41.535350+0000","last_fullsized":"2024-09-21T01:49:41.535350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:02.371670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737704+0000","last_change":"2024-09-21T01:49:40.356593+0000","last_active":"2024-09-21T01:49:41.737704+0000","last_peered":"2024-09-21T01:49:41.737704+0000","last_clean":"2024-09-21T01:49:41.737704+0000","last_became_active":"2024-09-21T01:49:40.356244+0000","last_became_peered":"2024-09-21T01:49:40.356244+0000","last_unstale":"2024-09-21T01:49:41.737704+0000","last_undegraded":"2024-09-21T01:49:41.737704+0000","last_fullsized":"2024-09-21T01:49:41.737704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:59:34.045247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737251+0000","last_change":"2024-09-21T01:49:39.356069+0000","last_active":"2024-09-21T01:49:41.737251+0000","last_peered":"2024-09-21T01:49:41.737251+0000","last_clean":"2024-09-21T01:49:41.737251+0000","last_became_active":"2024-09-21T01:49:39.355711+0000","last_became_peered":"2024-09-21T01:49:39.355711+0000","last_unstale":"2024-09-21T01:49:41.737251+0000","last_undegraded":"2024-09-21T01:49:41.737251+0000","last_fullsized":"2024-09-21T01:49:41.737251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:26.423985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350888+0000","last_change":"2024-09-21T01:49:40.365005+0000","last_active":"2024-09-21T01:49:41.350888+0000","last_peered":"2024-09-21T01:49:41.350888+0000","last_clean":"2024-09-21T01:49:41.350888+0000","last_became_active":"2024-09-21T01:49:40.364593+0000","last_became_peered":"2024-09-21T01:49:40.364593+0000","last_unstale":"2024-09-21T01:49:41.350888+0000","last_undegraded":"2024-09-21T01:49:41.350888+0000","last_fullsized":"2024-09-21T01:49:41.350888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:24.814662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736394+0000","last_change":"2024-09-21T01:49:39.354177+0000","last_active":"2024-09-21T01:49:41.736394+0000","last_peered":"2024-09-21T01:49:41.736394+0000","last_clean":"2024-09-21T01:49:41.736394+0000","last_became_active":"2024-09-21T01:49:39.353830+0000","last_became_peered":"2024-09-21T01:49:39.353830+0000","last_unstale":"2024-09-21T01:49:41.736394+0000","last_undegraded":"2024-09-21T01:49:41.736394+0000","last_fullsized":"2024-09-21T01:49:41.736394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:15.388595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353615+0000","last_change":"2024-09-21T01:49:40.351596+0000","last_active":"2024-09-21T01:49:41.353615+0000","last_peered":"2024-09-21T01:49:41.353615+0000","last_clean":"2024-09-21T01:49:41.353615+0000","last_became_active":"2024-09-21T01:49:40.350101+0000","last_became_peered":"2024-09-21T01:49:40.350101+0000","last_unstale":"2024-09-21T01:49:41.353615+0000","last_undegraded":"2024-09-21T01:49:41.353615+0000","last_fullsized":"2024-09-21T01:49:41.353615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:48.287340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535256+0000","last_change":"2024-09-21T01:49:39.347072+0000","last_active":"2024-09-21T01:49:41.535256+0000","last_peered":"2024-09-21T01:49:41.535256+0000","last_clean":"2024-09-21T01:49:41.535256+0000","last_became_active":"2024-09-21T01:49:39.346726+0000","last_became_peered":"2024-09-21T01:49:39.346726+0000","last_unstale":"2024-09-21T01:49:41.535256+0000","last_undegraded":"2024-09-21T01:49:41.535256+0000","last_fullsized":"2024-09-21T01:49:41.535256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:47.281134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737098+0000","last_change":"2024-09-21T01:49:40.361933+0000","last_active":"2024-09-21T01:49:41.737098+0000","last_peered":"2024-09-21T01:49:41.737098+0000","last_clean":"2024-09-21T01:49:41.737098+0000","last_became_active":"2024-09-21T01:49:40.361599+0000","last_became_peered":"2024-09-21T01:49:40.361599+0000","last_unstale":"2024-09-21T01:49:41.737098+0000","last_undegraded":"2024-09-21T01:49:41.737098+0000","last_fullsized":"2024-09-21T01:49:41.737098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:14.949645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351000+0000","last_change":"2024-09-21T01:49:39.352696+0000","last_active":"2024-09-21T01:49:41.351000+0000","last_peered":"2024-09-21T01:49:41.351000+0000","last_clean":"2024-09-21T01:49:41.351000+0000","last_became_active":"2024-09-21T01:49:39.352336+0000","last_became_peered":"2024-09-21T01:49:39.352336+0000","last_unstale":"2024-09-21T01:49:41.351000+0000","last_undegraded":"2024-09-21T01:49:41.351000+0000","last_fullsized":"2024-09-21T01:49:41.351000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:43.205610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350554+0000","last_change":"2024-09-21T01:49:40.349301+0000","last_active":"2024-09-21T01:49:41.350554+0000","last_peered":"2024-09-21T01:49:41.350554+0000","last_clean":"2024-09-21T01:49:41.350554+0000","last_became_active":"2024-09-21T01:49:40.348932+0000","last_became_peered":"2024-09-21T01:49:40.348932+0000","last_unstale":"2024-09-21T01:49:41.350554+0000","last_undegraded":"2024-09-21T01:49:41.350554+0000","last_fullsized":"2024-09-21T01:49:41.350554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:26.393817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737256+0000","last_change":"2024-09-21T01:49:39.354615+0000","last_active":"2024-09-21T01:49:41.737256+0000","last_peered":"2024-09-21T01:49:41.737256+0000","last_clean":"2024-09-21T01:49:41.737256+0000","last_became_active":"2024-09-21T01:49:39.354155+0000","last_became_peered":"2024-09-21T01:49:39.354155+0000","last_unstale":"2024-09-21T01:49:41.737256+0000","last_undegraded":"2024-09-21T01:49:41.737256+0000","last_fullsized":"2024-09-21T01:49:41.737256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:17.741128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737707+0000","last_change":"2024-09-21T01:49:40.358953+0000","last_active":"2024-09-21T01:49:41.737707+0000","last_peered":"2024-09-21T01:49:41.737707+0000","last_clean":"2024-09-21T01:49:41.737707+0000","last_became_active":"2024-09-21T01:49:40.358659+0000","last_became_peered":"2024-09-21T01:49:40.358659+0000","last_unstale":"2024-09-21T01:49:41.737707+0000","last_undegraded":"2024-09-21T01:49:41.737707+0000","last_fullsized":"2024-09-21T01:49:41.737707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:29.223285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535008+0000","last_change":"2024-09-21T01:49:39.344739+0000","last_active":"2024-09-21T01:49:41.535008+0000","last_peered":"2024-09-21T01:49:41.535008+0000","last_clean":"2024-09-21T01:49:41.535008+0000","last_became_active":"2024-09-21T01:49:39.344397+0000","last_became_peered":"2024-09-21T01:49:39.344397+0000","last_unstale":"2024-09-21T01:49:41.535008+0000","last_undegraded":"2024-09-21T01:49:41.535008+0000","last_fullsized":"2024-09-21T01:49:41.535008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:27.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535220+0000","last_change":"2024-09-21T01:49:40.364133+0000","last_active":"2024-09-21T01:49:41.535220+0000","last_peered":"2024-09-21T01:49:41.535220+0000","last_clean":"2024-09-21T01:49:41.535220+0000","last_became_active":"2024-09-21T01:49:40.363324+0000","last_became_peered":"2024-09-21T01:49:40.363324+0000","last_unstale":"2024-09-21T01:49:41.535220+0000","last_undegraded":"2024-09-21T01:49:41.535220+0000","last_fullsized":"2024-09-21T01:49:41.535220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:47.773242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735791+0000","last_change":"2024-09-21T01:49:39.352951+0000","last_active":"2024-09-21T01:49:41.735791+0000","last_peered":"2024-09-21T01:49:41.735791+0000","last_clean":"2024-09-21T01:49:41.735791+0000","last_became_active":"2024-09-21T01:49:39.352592+0000","last_became_peered":"2024-09-21T01:49:39.352592+0000","last_unstale":"2024-09-21T01:49:41.735791+0000","last_undegraded":"2024-09-21T01:49:41.735791+0000","last_fullsized":"2024-09-21T01:49:41.735791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:21.017265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737020+0000","last_change":"2024-09-21T01:49:40.356971+0000","last_active":"2024-09-21T01:49:41.737020+0000","last_peered":"2024-09-21T01:49:41.737020+0000","last_clean":"2024-09-21T01:49:41.737020+0000","last_became_active":"2024-09-21T01:49:40.356575+0000","last_became_peered":"2024-09-21T01:49:40.356575+0000","last_unstale":"2024-09-21T01:49:41.737020+0000","last_undegraded":"2024-09-21T01:49:41.737020+0000","last_fullsized":"2024-09-21T01:49:41.737020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:00.866709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353420+0000","last_change":"2024-09-21T01:49:39.350322+0000","last_active":"2024-09-21T01:49:41.353420+0000","last_peered":"2024-09-21T01:49:41.353420+0000","last_clean":"2024-09-21T01:49:41.353420+0000","last_became_active":"2024-09-21T01:49:39.349770+0000","last_became_peered":"2024-09-21T01:49:39.349770+0000","last_unstale":"2024-09-21T01:49:41.353420+0000","last_undegraded":"2024-09-21T01:49:41.353420+0000","last_fullsized":"2024-09-21T01:49:41.353420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:26.105437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737557+0000","last_change":"2024-09-21T01:49:40.364278+0000","last_active":"2024-09-21T01:49:41.737557+0000","last_peered":"2024-09-21T01:49:41.737557+0000","last_clean":"2024-09-21T01:49:41.737557+0000","last_became_active":"2024-09-21T01:49:40.363949+0000","last_became_peered":"2024-09-21T01:49:40.363949+0000","last_unstale":"2024-09-21T01:49:41.737557+0000","last_undegraded":"2024-09-21T01:49:41.737557+0000","last_fullsized":"2024-09-21T01:49:41.737557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:45.719101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736424+0000","last_change":"2024-09-21T01:49:39.346299+0000","last_active":"2024-09-21T01:49:41.736424+0000","last_peered":"2024-09-21T01:49:41.736424+0000","last_clean":"2024-09-21T01:49:41.736424+0000","last_became_active":"2024-09-21T01:49:39.345944+0000","last_became_peered":"2024-09-21T01:49:39.345944+0000","last_unstale":"2024-09-21T01:49:41.736424+0000","last_undegraded":"2024-09-21T01:49:41.736424+0000","last_fullsized":"2024-09-21T01:49:41.736424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:19.582036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.738129+0000","last_change":"2024-09-21T01:49:40.364893+0000","last_active":"2024-09-21T01:49:41.738129+0000","last_peered":"2024-09-21T01:49:41.738129+0000","last_clean":"2024-09-21T01:49:41.738129+0000","last_became_active":"2024-09-21T01:49:40.364145+0000","last_became_peered":"2024-09-21T01:49:40.364145+0000","last_unstale":"2024-09-21T01:49:41.738129+0000","last_undegraded":"2024-09-21T01:49:41.738129+0000","last_fullsized":"2024-09-21T01:49:41.738129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:03.444824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736525+0000","last_change":"2024-09-21T01:49:39.341903+0000","last_active":"2024-09-21T01:49:41.736525+0000","last_peered":"2024-09-21T01:49:41.736525+0000","last_clean":"2024-09-21T01:49:41.736525+0000","last_became_active":"2024-09-21T01:49:39.339820+0000","last_became_peered":"2024-09-21T01:49:39.339820+0000","last_unstale":"2024-09-21T01:49:41.736525+0000","last_undegraded":"2024-09-21T01:49:41.736525+0000","last_fullsized":"2024-09-21T01:49:41.736525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:09.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737057+0000","last_change":"2024-09-21T01:49:40.371573+0000","last_active":"2024-09-21T01:49:41.737057+0000","last_peered":"2024-09-21T01:49:41.737057+0000","last_clean":"2024-09-21T01:49:41.737057+0000","last_became_active":"2024-09-21T01:49:40.371260+0000","last_became_peered":"2024-09-21T01:49:40.371260+0000","last_unstale":"2024-09-21T01:49:41.737057+0000","last_undegraded":"2024-09-21T01:49:41.737057+0000","last_fullsized":"2024-09-21T01:49:41.737057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:52.256418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.735984+0000","last_change":"2024-09-21T01:49:39.357807+0000","last_active":"2024-09-21T01:49:41.735984+0000","last_peered":"2024-09-21T01:49:41.735984+0000","last_clean":"2024-09-21T01:49:41.735984+0000","last_became_active":"2024-09-21T01:49:39.357452+0000","last_became_peered":"2024-09-21T01:49:39.357452+0000","last_unstale":"2024-09-21T01:49:41.735984+0000","last_undegraded":"2024-09-21T01:49:41.735984+0000","last_fullsized":"2024-09-21T01:49:41.735984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:13.849909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737329+0000","last_change":"2024-09-21T01:49:40.361593+0000","last_active":"2024-09-21T01:49:41.737329+0000","last_peered":"2024-09-21T01:49:41.737329+0000","last_clean":"2024-09-21T01:49:41.737329+0000","last_became_active":"2024-09-21T01:49:40.360542+0000","last_became_peered":"2024-09-21T01:49:40.360542+0000","last_unstale":"2024-09-21T01:49:41.737329+0000","last_undegraded":"2024-09-21T01:49:41.737329+0000","last_fullsized":"2024-09-21T01:49:41.737329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:34:42.329087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736838+0000","last_change":"2024-09-21T01:49:29.995848+0000","last_active":"2024-09-21T01:49:41.736838+0000","last_peered":"2024-09-21T01:49:41.736838+0000","last_clean":"2024-09-21T01:49:41.736838+0000","last_became_active":"2024-09-21T01:49:29.994790+0000","last_became_peered":"2024-09-21T01:49:29.994790+0000","last_unstale":"2024-09-21T01:49:41.736838+0000","last_undegraded":"2024-09-21T01:49:41.736838+0000","last_fullsized":"2024-09-21T01:49:41.736838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_clean_scrub_stamp":"2024-09-21T01:49:28.252238+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:30.318506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736286+0000","last_change":"2024-09-21T01:49:39.356186+0000","last_active":"2024-09-21T01:49:41.736286+0000","last_peered":"2024-09-21T01:49:41.736286+0000","last_clean":"2024-09-21T01:49:41.736286+0000","last_became_active":"2024-09-21T01:49:39.354842+0000","last_became_peered":"2024-09-21T01:49:39.354842+0000","last_unstale":"2024-09-21T01:49:41.736286+0000","last_undegraded":"2024-09-21T01:49:41.736286+0000","last_fullsized":"2024-09-21T01:49:41.736286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352187+0000","last_change":"2024-09-21T01:49:40.363797+0000","last_active":"2024-09-21T01:49:41.352187+0000","last_peered":"2024-09-21T01:49:41.352187+0000","last_clean":"2024-09-21T01:49:41.352187+0000","last_became_active":"2024-09-21T01:49:40.363490+0000","last_became_peered":"2024-09-21T01:49:40.363490+0000","last_unstale":"2024-09-21T01:49:41.352187+0000","last_undegraded":"2024-09-21T01:49:41.352187+0000","last_fullsized":"2024-09-21T01:49:41.352187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:36.062812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736708+0000","last_change":"2024-09-21T01:49:39.356359+0000","last_active":"2024-09-21T01:49:41.736708+0000","last_peered":"2024-09-21T01:49:41.736708+0000","last_clean":"2024-09-21T01:49:41.736708+0000","last_became_active":"2024-09-21T01:49:39.356029+0000","last_became_peered":"2024-09-21T01:49:39.356029+0000","last_unstale":"2024-09-21T01:49:41.736708+0000","last_undegraded":"2024-09-21T01:49:41.736708+0000","last_fullsized":"2024-09-21T01:49:41.736708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:47.281134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350257+0000","last_change":"2024-09-21T01:49:40.346325+0000","last_active":"2024-09-21T01:49:41.350257+0000","last_peered":"2024-09-21T01:49:41.350257+0000","last_clean":"2024-09-21T01:49:41.350257+0000","last_became_active":"2024-09-21T01:49:40.345976+0000","last_became_peered":"2024-09-21T01:49:40.345976+0000","last_unstale":"2024-09-21T01:49:41.350257+0000","last_undegraded":"2024-09-21T01:49:41.350257+0000","last_fullsized":"2024-09-21T01:49:41.350257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:16.293654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736138+0000","last_change":"2024-09-21T01:49:39.346504+0000","last_active":"2024-09-21T01:49:41.736138+0000","last_peered":"2024-09-21T01:49:41.736138+0000","last_clean":"2024-09-21T01:49:41.736138+0000","last_became_active":"2024-09-21T01:49:39.345964+0000","last_became_peered":"2024-09-21T01:49:39.345964+0000","last_unstale":"2024-09-21T01:49:41.736138+0000","last_undegraded":"2024-09-21T01:49:41.736138+0000","last_fullsized":"2024-09-21T01:49:41.736138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736581+0000","last_change":"2024-09-21T01:49:40.355895+0000","last_active":"2024-09-21T01:49:41.736581+0000","last_peered":"2024-09-21T01:49:41.736581+0000","last_clean":"2024-09-21T01:49:41.736581+0000","last_became_active":"2024-09-21T01:49:40.355565+0000","last_became_peered":"2024-09-21T01:49:40.355565+0000","last_unstale":"2024-09-21T01:49:41.736581+0000","last_undegraded":"2024-09-21T01:49:41.736581+0000","last_fullsized":"2024-09-21T01:49:41.736581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:38:32.806782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737699+0000","last_change":"2024-09-21T01:49:39.354243+0000","last_active":"2024-09-21T01:49:41.737699+0000","last_peered":"2024-09-21T01:49:41.737699+0000","last_clean":"2024-09-21T01:49:41.737699+0000","last_became_active":"2024-09-21T01:49:39.353072+0000","last_became_peered":"2024-09-21T01:49:39.353072+0000","last_unstale":"2024-09-21T01:49:41.737699+0000","last_undegraded":"2024-09-21T01:49:41.737699+0000","last_fullsized":"2024-09-21T01:49:41.737699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:17.764196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353693+0000","last_change":"2024-09-21T01:49:40.352821+0000","last_active":"2024-09-21T01:49:41.353693+0000","last_peered":"2024-09-21T01:49:41.353693+0000","last_clean":"2024-09-21T01:49:41.353693+0000","last_became_active":"2024-09-21T01:49:40.351889+0000","last_became_peered":"2024-09-21T01:49:40.351889+0000","last_unstale":"2024-09-21T01:49:41.353693+0000","last_undegraded":"2024-09-21T01:49:41.353693+0000","last_fullsized":"2024-09-21T01:49:41.353693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:05.023859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736502+0000","last_change":"2024-09-21T01:49:39.351127+0000","last_active":"2024-09-21T01:49:41.736502+0000","last_peered":"2024-09-21T01:49:41.736502+0000","last_clean":"2024-09-21T01:49:41.736502+0000","last_became_active":"2024-09-21T01:49:39.350783+0000","last_became_peered":"2024-09-21T01:49:39.350783+0000","last_unstale":"2024-09-21T01:49:41.736502+0000","last_undegraded":"2024-09-21T01:49:41.736502+0000","last_fullsized":"2024-09-21T01:49:41.736502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:42.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737434+0000","last_change":"2024-09-21T01:49:40.368882+0000","last_active":"2024-09-21T01:49:41.737434+0000","last_peered":"2024-09-21T01:49:41.737434+0000","last_clean":"2024-09-21T01:49:41.737434+0000","last_became_active":"2024-09-21T01:49:40.367820+0000","last_became_peered":"2024-09-21T01:49:40.367820+0000","last_unstale":"2024-09-21T01:49:41.737434+0000","last_undegraded":"2024-09-21T01:49:41.737434+0000","last_fullsized":"2024-09-21T01:49:41.737434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:45.001295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737894+0000","last_change":"2024-09-21T01:49:39.356508+0000","last_active":"2024-09-21T01:49:41.737894+0000","last_peered":"2024-09-21T01:49:41.737894+0000","last_clean":"2024-09-21T01:49:41.737894+0000","last_became_active":"2024-09-21T01:49:39.356169+0000","last_became_peered":"2024-09-21T01:49:39.356169+0000","last_unstale":"2024-09-21T01:49:41.737894+0000","last_undegraded":"2024-09-21T01:49:41.737894+0000","last_fullsized":"2024-09-21T01:49:41.737894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:52.672165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736513+0000","last_change":"2024-09-21T01:49:40.351790+0000","last_active":"2024-09-21T01:49:41.736513+0000","last_peered":"2024-09-21T01:49:41.736513+0000","last_clean":"2024-09-21T01:49:41.736513+0000","last_became_active":"2024-09-21T01:49:40.351392+0000","last_became_peered":"2024-09-21T01:49:40.351392+0000","last_unstale":"2024-09-21T01:49:41.736513+0000","last_undegraded":"2024-09-21T01:49:41.736513+0000","last_fullsized":"2024-09-21T01:49:41.736513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:36:45.440468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:42.340972+0000","last_change":"2024-09-21T01:49:39.353294+0000","last_active":"2024-09-21T01:49:42.340972+0000","last_peered":"2024-09-21T01:49:42.340972+0000","last_clean":"2024-09-21T01:49:42.340972+0000","last_became_active":"2024-09-21T01:49:39.352984+0000","last_became_peered":"2024-09-21T01:49:39.352984+0000","last_unstale":"2024-09-21T01:49:42.340972+0000","last_undegraded":"2024-09-21T01:49:42.340972+0000","last_fullsized":"2024-09-21T01:49:42.340972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:31.319877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351908+0000","last_change":"2024-09-21T01:49:40.351451+0000","last_active":"2024-09-21T01:49:41.351908+0000","last_peered":"2024-09-21T01:49:41.351908+0000","last_clean":"2024-09-21T01:49:41.351908+0000","last_became_active":"2024-09-21T01:49:40.351100+0000","last_became_peered":"2024-09-21T01:49:40.351100+0000","last_unstale":"2024-09-21T01:49:41.351908+0000","last_undegraded":"2024-09-21T01:49:41.351908+0000","last_fullsized":"2024-09-21T01:49:41.351908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:15.787679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535436+0000","last_change":"2024-09-21T01:49:39.353205+0000","last_active":"2024-09-21T01:49:41.535436+0000","last_peered":"2024-09-21T01:49:41.535436+0000","last_clean":"2024-09-21T01:49:41.535436+0000","last_became_active":"2024-09-21T01:49:39.352858+0000","last_became_peered":"2024-09-21T01:49:39.352858+0000","last_unstale":"2024-09-21T01:49:41.535436+0000","last_undegraded":"2024-09-21T01:49:41.535436+0000","last_fullsized":"2024-09-21T01:49:41.535436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:35.086866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350768+0000","last_change":"2024-09-21T01:49:40.354056+0000","last_active":"2024-09-21T01:49:41.350768+0000","last_peered":"2024-09-21T01:49:41.350768+0000","last_clean":"2024-09-21T01:49:41.350768+0000","last_became_active":"2024-09-21T01:49:40.353701+0000","last_became_peered":"2024-09-21T01:49:40.353701+0000","last_unstale":"2024-09-21T01:49:41.350768+0000","last_undegraded":"2024-09-21T01:49:41.350768+0000","last_fullsized":"2024-09-21T01:49:41.350768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:36.817174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736561+0000","last_change":"2024-09-21T01:49:39.355387+0000","last_active":"2024-09-21T01:49:41.736561+0000","last_peered":"2024-09-21T01:49:41.736561+0000","last_clean":"2024-09-21T01:49:41.736561+0000","last_became_active":"2024-09-21T01:49:39.355048+0000","last_became_peered":"2024-09-21T01:49:39.355048+0000","last_unstale":"2024-09-21T01:49:41.736561+0000","last_undegraded":"2024-09-21T01:49:41.736561+0000","last_fullsized":"2024-09-21T01:49:41.736561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:27.391305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.353474+0000","last_change":"2024-09-21T01:49:40.351959+0000","last_active":"2024-09-21T01:49:41.353474+0000","last_peered":"2024-09-21T01:49:41.353474+0000","last_clean":"2024-09-21T01:49:41.353474+0000","last_became_active":"2024-09-21T01:49:40.351308+0000","last_became_peered":"2024-09-21T01:49:40.351308+0000","last_unstale":"2024-09-21T01:49:41.353474+0000","last_undegraded":"2024-09-21T01:49:41.353474+0000","last_fullsized":"2024-09-21T01:49:41.353474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:28.397512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736277+0000","last_change":"2024-09-21T01:49:39.350179+0000","last_active":"2024-09-21T01:49:41.736277+0000","last_peered":"2024-09-21T01:49:41.736277+0000","last_clean":"2024-09-21T01:49:41.736277+0000","last_became_active":"2024-09-21T01:49:39.347968+0000","last_became_peered":"2024-09-21T01:49:39.347968+0000","last_unstale":"2024-09-21T01:49:41.736277+0000","last_undegraded":"2024-09-21T01:49:41.736277+0000","last_fullsized":"2024-09-21T01:49:41.736277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:06.359377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352083+0000","last_change":"2024-09-21T01:49:40.354991+0000","last_active":"2024-09-21T01:49:41.352083+0000","last_peered":"2024-09-21T01:49:41.352083+0000","last_clean":"2024-09-21T01:49:41.352083+0000","last_became_active":"2024-09-21T01:49:40.352773+0000","last_became_peered":"2024-09-21T01:49:40.352773+0000","last_unstale":"2024-09-21T01:49:41.352083+0000","last_undegraded":"2024-09-21T01:49:41.352083+0000","last_fullsized":"2024-09-21T01:49:41.352083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:26.545436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736233+0000","last_change":"2024-09-21T01:49:39.349158+0000","last_active":"2024-09-21T01:49:41.736233+0000","last_peered":"2024-09-21T01:49:41.736233+0000","last_clean":"2024-09-21T01:49:41.736233+0000","last_became_active":"2024-09-21T01:49:39.347821+0000","last_became_peered":"2024-09-21T01:49:39.347821+0000","last_unstale":"2024-09-21T01:49:41.736233+0000","last_undegraded":"2024-09-21T01:49:41.736233+0000","last_fullsized":"2024-09-21T01:49:41.736233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:02.187963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.352318+0000","last_change":"2024-09-21T01:49:40.355562+0000","last_active":"2024-09-21T01:49:41.352318+0000","last_peered":"2024-09-21T01:49:41.352318+0000","last_clean":"2024-09-21T01:49:41.352318+0000","last_became_active":"2024-09-21T01:49:40.354546+0000","last_became_peered":"2024-09-21T01:49:40.354546+0000","last_unstale":"2024-09-21T01:49:41.352318+0000","last_undegraded":"2024-09-21T01:49:41.352318+0000","last_fullsized":"2024-09-21T01:49:41.352318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:52.645109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737751+0000","last_change":"2024-09-21T01:49:39.358033+0000","last_active":"2024-09-21T01:49:41.737751+0000","last_peered":"2024-09-21T01:49:41.737751+0000","last_clean":"2024-09-21T01:49:41.737751+0000","last_became_active":"2024-09-21T01:49:39.357680+0000","last_became_peered":"2024-09-21T01:49:39.357680+0000","last_unstale":"2024-09-21T01:49:41.737751+0000","last_undegraded":"2024-09-21T01:49:41.737751+0000","last_fullsized":"2024-09-21T01:49:41.737751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:09:19.831260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.535186+0000","last_change":"2024-09-21T01:49:40.365613+0000","last_active":"2024-09-21T01:49:41.535186+0000","last_peered":"2024-09-21T01:49:41.535186+0000","last_clean":"2024-09-21T01:49:41.535186+0000","last_became_active":"2024-09-21T01:49:40.365297+0000","last_became_peered":"2024-09-21T01:49:40.365297+0000","last_unstale":"2024-09-21T01:49:41.535186+0000","last_undegraded":"2024-09-21T01:49:41.535186+0000","last_fullsized":"2024-09-21T01:49:41.535186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:17.999168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736952+0000","last_change":"2024-09-21T01:49:40.367268+0000","last_active":"2024-09-21T01:49:41.736952+0000","last_peered":"2024-09-21T01:49:41.736952+0000","last_clean":"2024-09-21T01:49:41.736952+0000","last_became_active":"2024-09-21T01:49:40.366946+0000","last_became_peered":"2024-09-21T01:49:40.366946+0000","last_unstale":"2024-09-21T01:49:41.736952+0000","last_undegraded":"2024-09-21T01:49:41.736952+0000","last_fullsized":"2024-09-21T01:49:41.736952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:29.301249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.736693+0000","last_change":"2024-09-21T01:49:39.359266+0000","last_active":"2024-09-21T01:49:41.736693+0000","last_peered":"2024-09-21T01:49:41.736693+0000","last_clean":"2024-09-21T01:49:41.736693+0000","last_became_active":"2024-09-21T01:49:39.358350+0000","last_became_peered":"2024-09-21T01:49:39.358350+0000","last_unstale":"2024-09-21T01:49:41.736693+0000","last_undegraded":"2024-09-21T01:49:41.736693+0000","last_fullsized":"2024-09-21T01:49:41.736693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:43.979023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737278+0000","last_change":"2024-09-21T01:49:40.367875+0000","last_active":"2024-09-21T01:49:41.737278+0000","last_peered":"2024-09-21T01:49:41.737278+0000","last_clean":"2024-09-21T01:49:41.737278+0000","last_became_active":"2024-09-21T01:49:40.367529+0000","last_became_peered":"2024-09-21T01:49:40.367529+0000","last_unstale":"2024-09-21T01:49:41.737278+0000","last_undegraded":"2024-09-21T01:49:41.737278+0000","last_fullsized":"2024-09-21T01:49:41.737278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:17.573511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.737423+0000","last_change":"2024-09-21T01:49:39.359628+0000","last_active":"2024-09-21T01:49:41.737423+0000","last_peered":"2024-09-21T01:49:41.737423+0000","last_clean":"2024-09-21T01:49:41.737423+0000","last_became_active":"2024-09-21T01:49:39.359209+0000","last_became_peered":"2024-09-21T01:49:39.359209+0000","last_unstale":"2024-09-21T01:49:41.737423+0000","last_undegraded":"2024-09-21T01:49:41.737423+0000","last_fullsized":"2024-09-21T01:49:41.737423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:04.017652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350648+0000","last_change":"2024-09-21T01:49:40.364917+0000","last_active":"2024-09-21T01:49:41.350648+0000","last_peered":"2024-09-21T01:49:41.350648+0000","last_clean":"2024-09-21T01:49:41.350648+0000","last_became_active":"2024-09-21T01:49:40.364166+0000","last_became_peered":"2024-09-21T01:49:40.364166+0000","last_unstale":"2024-09-21T01:49:41.350648+0000","last_undegraded":"2024-09-21T01:49:41.350648+0000","last_fullsized":"2024-09-21T01:49:41.350648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:08.726343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351636+0000","last_change":"2024-09-21T01:49:39.356150+0000","last_active":"2024-09-21T01:49:41.351636+0000","last_peered":"2024-09-21T01:49:41.351636+0000","last_clean":"2024-09-21T01:49:41.351636+0000","last_became_active":"2024-09-21T01:49:39.355548+0000","last_became_peered":"2024-09-21T01:49:39.355548+0000","last_unstale":"2024-09-21T01:49:41.351636+0000","last_undegraded":"2024-09-21T01:49:41.351636+0000","last_fullsized":"2024-09-21T01:49:41.351636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:02.371670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.351655+0000","last_change":"2024-09-21T01:49:40.357471+0000","last_active":"2024-09-21T01:49:41.351655+0000","last_peered":"2024-09-21T01:49:41.351655+0000","last_clean":"2024-09-21T01:49:41.351655+0000","last_became_active":"2024-09-21T01:49:40.357158+0000","last_became_peered":"2024-09-21T01:49:40.357158+0000","last_unstale":"2024-09-21T01:49:41.351655+0000","last_undegraded":"2024-09-21T01:49:41.351655+0000","last_fullsized":"2024-09-21T01:49:41.351655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:39.326767+0000","last_clean_scrub_stamp":"2024-09-21T01:49:39.326767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:22:28.048336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T01:49:41.350824+0000","last_change":"2024-09-21T01:49:39.354483+0000","last_active":"2024-09-21T01:49:41.350824+0000","last_peered":"2024-09-21T01:49:41.350824+0000","last_clean":"2024-09-21T01:49:41.350824+0000","last_became_active":"2024-09-21T01:49:39.354167+0000","last_became_peered":"2024-09-21T01:49:39.354167+0000","last_unstale":"2024-09-21T01:49:41.350824+0000","last_undegraded":"2024-09-21T01:49:41.350824+0000","last_fullsized":"2024-09-21T01:49:41.350824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:38.320560+0000","last_clean_scrub_stamp":"2024-09-21T01:49:38.320560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:08:48.875745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":72057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":72093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":662973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:49:52.554 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T01:49:52.554 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T01:49:52.554 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T01:49:52.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T01:49:52.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.704+0000 7fad91928640 1 -- 172.21.15.40:0/800752064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad78005320 msgr2=0x7fad7800b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.704+0000 7fad91928640 1 --2- 172.21.15.40:0/800752064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad78005320 0x7fad7800b9e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fad7c006fb0 tx=0x7fad78005830 comp rx=0 tx=0).stop 2024-09-21T01:49:52.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.704+0000 7fad91928640 1 -- 172.21.15.40:0/800752064 shutdown_connections 2024-09-21T01:49:52.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.704+0000 7fad91928640 1 --2- 172.21.15.40:0/800752064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad78005320 0x7fad7800b9e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.704+0000 7fad91928640 1 -- 172.21.15.40:0/800752064 >> 172.21.15.40:0/800752064 conn(0x7fad8c0710b0 msgr2=0x7fad8c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:52.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.704+0000 7fad91928640 1 -- 172.21.15.40:0/800752064 shutdown_connections 2024-09-21T01:49:52.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.704+0000 7fad91928640 1 -- 172.21.15.40:0/800752064 wait complete. 2024-09-21T01:49:52.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.706+0000 7fad91928640 1 Processor -- start 2024-09-21T01:49:52.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.706+0000 7fad91928640 1 -- start start 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad91928640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78005320 0x7fad8c1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad91928640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad8c0c8850 0x7fad8c0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad91928640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c0c7f90 0x7fad8c1f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad91928640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c0ced30 con 0x7fad8c0c7f90 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad91928640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c15ca10 con 0x7fad78005320 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad91928640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c0ceeb0 con 0x7fad8c0c8850 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad8b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c0c7f90 0x7fad8c1f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad8b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c0c7f90 0x7fad8c1f2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33498/0 (socket says 172.21.15.40:33498) 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad8b7fe640 1 -- 172.21.15.40:0/1730543747 learned_addr learned my addr 172.21.15.40:0/1730543747 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad8affd640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78005320 0x7fad8c1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad8a7fc640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad8c0c8850 0x7fad8c0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:52.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.707+0000 7fad8b7fe640 1 -- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad8c0c8850 msgr2=0x7fad8c0c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad8b7fe640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad8c0c8850 0x7fad8c0c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad8b7fe640 1 -- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78005320 msgr2=0x7fad8c1f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad8b7fe640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78005320 0x7fad8c1f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad8b7fe640 1 -- 172.21.15.40:0/1730543747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c0c83a0 con 0x7fad8c0c7f90 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad8b7fe640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c0c7f90 0x7fad8c1f2ea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fad7c02b0a0 tx=0x7fad7c006c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad83fff640 1 -- 172.21.15.40:0/1730543747 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0037f0 con 0x7fad8c0c7f90 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad83fff640 1 -- 172.21.15.40:0/1730543747 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad7c03b070 con 0x7fad8c0c7f90 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad83fff640 1 -- 172.21.15.40:0/1730543747 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c003c50 con 0x7fad8c0c7f90 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8c1f64c0 con 0x7fad8c0c7f90 2024-09-21T01:49:52.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.708+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8c1f6a80 con 0x7fad8c0c7f90 2024-09-21T01:49:52.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.709+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad8c0cf3c0 con 0x7fad8c0c7f90 2024-09-21T01:49:52.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.710+0000 7fad83fff640 1 -- 172.21.15.40:0/1730543747 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad7c035020 con 0x7fad8c0c7f90 2024-09-21T01:49:52.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.710+0000 7fad83fff640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fad6c078bc0 0x7fad6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:52.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.710+0000 7fad83fff640 1 -- 172.21.15.40:0/1730543747 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fad7c0bad80 con 0x7fad8c0c7f90 2024-09-21T01:49:52.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.711+0000 7fad8affd640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fad6c078bc0 0x7fad6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:52.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.711+0000 7fad8affd640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fad6c078bc0 0x7fad6c07b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fad84006fd0 tx=0x7fad84006f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:52.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.715+0000 7fad83fff640 1 -- 172.21.15.40:0/1730543747 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fad8c0c83a0 con 0x7fad8c0c7f90 2024-09-21T01:49:52.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.945+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fad8c0b2a00 con 0x7fad8c0c7f90 2024-09-21T01:49:52.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.946+0000 7fad83fff640 1 -- 172.21.15.40:0/1730543747 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fad7c082ad0 con 0x7fad8c0c7f90 2024-09-21T01:49:52.948 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:52.948 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T01:49:52.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fad6c078bc0 msgr2=0x7fad6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fad6c078bc0 0x7fad6c07b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fad84006fd0 tx=0x7fad84006f60 comp rx=0 tx=0).stop 2024-09-21T01:49:52.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c0c7f90 msgr2=0x7fad8c1f2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:52.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c0c7f90 0x7fad8c1f2ea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fad7c02b0a0 tx=0x7fad7c006c40 comp rx=0 tx=0).stop 2024-09-21T01:49:52.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 shutdown_connections 2024-09-21T01:49:52.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fad6c078bc0 0x7fad6c07b0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad8c0c7f90 0x7fad8c1f2ea0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fad8c0c8850 0x7fad8c0c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 --2- 172.21.15.40:0/1730543747 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fad78005320 0x7fad8c1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:52.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 >> 172.21.15.40:0/1730543747 conn(0x7fad8c0710b0 msgr2=0x7fad8c15ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:52.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 shutdown_connections 2024-09-21T01:49:52.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:52.948+0000 7fad91928640 1 -- 172.21.15.40:0/1730543747 wait complete. 2024-09-21T01:49:52.961 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T01:49:52.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:49:53.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.076+0000 7fdcdbdba640 1 -- 172.21.15.40:0/327335826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcd4074420 msgr2=0x7fdcd406fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.076+0000 7fdcdbdba640 1 --2- 172.21.15.40:0/327335826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcd4074420 0x7fdcd406fe30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009830 tx=0x7fdccc02a5c0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.076+0000 7fdcdbdba640 1 -- 172.21.15.40:0/327335826 shutdown_connections 2024-09-21T01:49:53.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.076+0000 7fdcdbdba640 1 --2- 172.21.15.40:0/327335826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcd4074420 0x7fdcd406fe30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.076+0000 7fdcdbdba640 1 -- 172.21.15.40:0/327335826 >> 172.21.15.40:0/327335826 conn(0x7fdcd406def0 msgr2=0x7fdcd406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:53.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.076+0000 7fdcdbdba640 1 -- 172.21.15.40:0/327335826 shutdown_connections 2024-09-21T01:49:53.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.076+0000 7fdcdbdba640 1 -- 172.21.15.40:0/327335826 wait complete. 2024-09-21T01:49:53.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.077+0000 7fdcdbdba640 1 Processor -- start 2024-09-21T01:49:53.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.078+0000 7fdcdbdba640 1 -- start start 2024-09-21T01:49:53.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcdbdba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4074420 0x7fdcd414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcdbdba640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcd4155ce0 0x7fdcd41f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcdbdba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcd4150cc0 0x7fdcd41f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcdbdba640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd40b5280 con 0x7fdcd4074420 2024-09-21T01:49:53.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcdbdba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd40b5100 con 0x7fdcd4150cc0 2024-09-21T01:49:53.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcdbdba640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd40b5400 con 0x7fdcd4155ce0 2024-09-21T01:49:53.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9b56640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4074420 0x7fdcd414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9b56640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4074420 0x7fdcd414aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33506/0 (socket says 172.21.15.40:33506) 2024-09-21T01:49:53.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9b56640 1 -- 172.21.15.40:0/1106173158 learned_addr learned my addr 172.21.15.40:0/1106173158 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcda357640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcd4150cc0 0x7fdcd41f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9355640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcd4155ce0 0x7fdcd41f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9b56640 1 -- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcd4155ce0 msgr2=0x7fdcd41f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9b56640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcd4155ce0 0x7fdcd41f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9b56640 1 -- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcd4150cc0 msgr2=0x7fdcd41f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9b56640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcd4150cc0 0x7fdcd41f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9b56640 1 -- 172.21.15.40:0/1106173158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd40b2f60 con 0x7fdcd4074420 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9355640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcd4155ce0 0x7fdcd41f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.079+0000 7fdcd9b56640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4074420 0x7fdcd414aa90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009950 tx=0x7fdccc033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.080+0000 7fdcd27fc640 1 -- 172.21.15.40:0/1106173158 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc031b50 con 0x7fdcd4074420 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.080+0000 7fdcd27fc640 1 -- 172.21.15.40:0/1106173158 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdccc031de0 con 0x7fdcd4074420 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.080+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd40b3240 con 0x7fdcd4074420 2024-09-21T01:49:53.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.080+0000 7fdcd27fc640 1 -- 172.21.15.40:0/1106173158 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc005280 con 0x7fdcd4074420 2024-09-21T01:49:53.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.080+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd40aab60 con 0x7fdcd4074420 2024-09-21T01:49:53.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.081+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd415c580 con 0x7fdcd4074420 2024-09-21T01:49:53.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.082+0000 7fdcd27fc640 1 -- 172.21.15.40:0/1106173158 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdccc005420 con 0x7fdcd4074420 2024-09-21T01:49:53.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.082+0000 7fdcd27fc640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdcc0078bc0 0x7fdcc007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.082+0000 7fdcd27fc640 1 -- 172.21.15.40:0/1106173158 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdccc0bbd30 con 0x7fdcd4074420 2024-09-21T01:49:53.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.082+0000 7fdcd9355640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdcc0078bc0 0x7fdcc007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.083+0000 7fdcd9355640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdcc0078bc0 0x7fdcc007b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcd415cf80 tx=0x7fdcc8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:53.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.087+0000 7fdcd27fc640 1 -- 172.21.15.40:0/1106173158 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdccc03f030 con 0x7fdcd4074420 2024-09-21T01:49:53.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.313+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdcd40b5b60 con 0x7fdcd4074420 2024-09-21T01:49:53.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.314+0000 7fdcd27fc640 1 -- 172.21.15.40:0/1106173158 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fdccc084290 con 0x7fdcd4074420 2024-09-21T01:49:53.316 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:53.316 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-21T01:49:43:356671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1396929132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1396929132},{"type":"v1","addr":"172.21.15.40:6835","nonce":1396929132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/4017969431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4017969431},{"type":"v1","addr":"172.21.15.139:6836","nonce":4017969431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:49:39.729464+0000","modified":"2024-09-21T01:49:42.736647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6837/1192218063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":1192218063},{"type":"v1","addr":"172.21.15.139:6837","nonce":1192218063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T01:49:53.316 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-21T01:49:53.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdcc0078bc0 msgr2=0x7fdcc007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdcc0078bc0 0x7fdcc007b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdcd415cf80 tx=0x7fdcc8009040 comp rx=0 tx=0).stop 2024-09-21T01:49:53.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4074420 msgr2=0x7fdcd414aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4074420 0x7fdcd414aa90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009950 tx=0x7fdccc033ba0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 shutdown_connections 2024-09-21T01:49:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdcc0078bc0 0x7fdcc007b0d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcd4150cc0 0x7fdcd41f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcd4155ce0 0x7fdcd41f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 --2- 172.21.15.40:0/1106173158 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcd4074420 0x7fdcd414aa90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 >> 172.21.15.40:0/1106173158 conn(0x7fdcd406def0 msgr2=0x7fdcd4154fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 shutdown_connections 2024-09-21T01:49:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.316+0000 7fdcdbdba640 1 -- 172.21.15.40:0/1106173158 wait complete. 2024-09-21T01:49:53.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:49:53.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.444+0000 7ff80d79d640 1 -- 172.21.15.40:0/462547167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080b4a00 msgr2=0x7ff8080cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.444+0000 7ff80d79d640 1 --2- 172.21.15.40:0/462547167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080b4a00 0x7ff8080cf3e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff800005fd0 tx=0x7ff80002a820 comp rx=0 tx=0).stop 2024-09-21T01:49:53.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.444+0000 7ff80d79d640 1 -- 172.21.15.40:0/462547167 shutdown_connections 2024-09-21T01:49:53.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.444+0000 7ff80d79d640 1 --2- 172.21.15.40:0/462547167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080b4a00 0x7ff8080cf3e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.444+0000 7ff80d79d640 1 -- 172.21.15.40:0/462547167 >> 172.21.15.40:0/462547167 conn(0x7ff80809d680 msgr2=0x7ff8080d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:53.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.444+0000 7ff80d79d640 1 -- 172.21.15.40:0/462547167 shutdown_connections 2024-09-21T01:49:53.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.444+0000 7ff80d79d640 1 -- 172.21.15.40:0/462547167 wait complete. 2024-09-21T01:49:53.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.446+0000 7ff80d79d640 1 Processor -- start 2024-09-21T01:49:53.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.446+0000 7ff80d79d640 1 -- start start 2024-09-21T01:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.447+0000 7ff80d79d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8080b4a00 0x7ff8080a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.447+0000 7ff80d79d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8080b96b0 0x7ff808160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.447+0000 7ff80d79d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080cefd0 0x7ff80815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.447+0000 7ff80d79d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff8080b5040 con 0x7ff8080cefd0 2024-09-21T01:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.447+0000 7ff80d79d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff8080b4ec0 con 0x7ff8080b4a00 2024-09-21T01:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.447+0000 7ff80d79d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7ff80816a0a0 con 0x7ff8080b96b0 2024-09-21T01:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.447+0000 7ff80cf9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080cefd0 0x7ff80815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.447+0000 7ff80cf9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080cefd0 0x7ff80815d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33530/0 (socket says 172.21.15.40:33530) 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.447+0000 7ff80cf9c640 1 -- 172.21.15.40:0/1882643008 learned_addr learned my addr 172.21.15.40:0/1882643008 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff807fff640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8080b4a00 0x7ff8080a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff8077fe640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8080b96b0 0x7ff808160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff80cf9c640 1 -- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8080b96b0 msgr2=0x7ff808160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff80cf9c640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8080b96b0 0x7ff808160be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff80cf9c640 1 -- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8080b4a00 msgr2=0x7ff8080a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff80cf9c640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8080b4a00 0x7ff8080a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff80cf9c640 1 -- 172.21.15.40:0/1882643008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff808166f30 con 0x7ff8080cefd0 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff8077fe640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8080b96b0 0x7ff808160be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff80cf9c640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080cefd0 0x7ff80815d170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff800009b30 tx=0x7ff800032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff804ff9640 1 -- 172.21.15.40:0/1882643008 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff800037040 con 0x7ff8080cefd0 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff804ff9640 1 -- 172.21.15.40:0/1882643008 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff800042070 con 0x7ff8080cefd0 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff808164110 con 0x7ff8080cefd0 2024-09-21T01:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff804ff9640 1 -- 172.21.15.40:0/1882643008 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8000042a0 con 0x7ff8080cefd0 2024-09-21T01:49:53.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.448+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff808166c50 con 0x7ff8080cefd0 2024-09-21T01:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.449+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8080cf3e0 con 0x7ff8080cefd0 2024-09-21T01:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.450+0000 7ff804ff9640 1 -- 172.21.15.40:0/1882643008 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff800004440 con 0x7ff8080cefd0 2024-09-21T01:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.451+0000 7ff804ff9640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff7f4078b90 0x7ff7f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.451+0000 7ff804ff9640 1 -- 172.21.15.40:0/1882643008 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff8000bbc20 con 0x7ff8080cefd0 2024-09-21T01:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.451+0000 7ff807fff640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff7f4078b90 0x7ff7f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.451+0000 7ff807fff640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff7f4078b90 0x7ff7f407b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff8080b5780 tx=0x7ff7f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:53.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.455+0000 7ff804ff9640 1 -- 172.21.15.40:0/1882643008 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff800083fc0 con 0x7ff8080cefd0 2024-09-21T01:49:53.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.680+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8080d4c60 con 0x7ff8080cefd0 2024-09-21T01:49:53.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.681+0000 7ff804ff9640 1 -- 172.21.15.40:0/1882643008 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7ff8000838c0 con 0x7ff8080cefd0 2024-09-21T01:49:53.682 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:53.682 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-21T01:49:43:356671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1396929132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1396929132},{"type":"v1","addr":"172.21.15.40:6835","nonce":1396929132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/4017969431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4017969431},{"type":"v1","addr":"172.21.15.139:6836","nonce":4017969431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:49:39.729464+0000","modified":"2024-09-21T01:49:42.736647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6837/1192218063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":1192218063},{"type":"v1","addr":"172.21.15.139:6837","nonce":1192218063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T01:49:53.683 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-21T01:49:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff7f4078b90 msgr2=0x7ff7f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff7f4078b90 0x7ff7f407b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff8080b5780 tx=0x7ff7f8009040 comp rx=0 tx=0).stop 2024-09-21T01:49:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080cefd0 msgr2=0x7ff80815d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080cefd0 0x7ff80815d170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff800009b30 tx=0x7ff800032d10 comp rx=0 tx=0).stop 2024-09-21T01:49:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 shutdown_connections 2024-09-21T01:49:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff7f4078b90 0x7ff7f407b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8080cefd0 0x7ff80815d170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff8080b96b0 0x7ff808160be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 --2- 172.21.15.40:0/1882643008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8080b4a00 0x7ff8080a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 >> 172.21.15.40:0/1882643008 conn(0x7ff80809d680 msgr2=0x7ff8080b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 shutdown_connections 2024-09-21T01:49:53.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.683+0000 7ff80d79d640 1 -- 172.21.15.40:0/1882643008 wait complete. 2024-09-21T01:49:53.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:49:53.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.810+0000 7f3b1e09b640 1 -- 172.21.15.40:0/233225292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b00004800 msgr2=0x7f3b00004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.810+0000 7f3b1e09b640 1 --2- 172.21.15.40:0/233225292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b00004800 0x7f3b00004c10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009b50 tx=0x7f3b00005830 comp rx=0 tx=0).stop 2024-09-21T01:49:53.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.810+0000 7f3b17fff640 1 -- 172.21.15.40:0/233225292 reap_dead start 2024-09-21T01:49:53.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.810+0000 7f3b1e09b640 1 -- 172.21.15.40:0/233225292 shutdown_connections 2024-09-21T01:49:53.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.810+0000 7f3b1e09b640 1 -- 172.21.15.40:0/233225292 >> 172.21.15.40:0/233225292 conn(0x7f3b1809d840 msgr2=0x7f3b1808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:53.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.811+0000 7f3b1e09b640 1 -- 172.21.15.40:0/233225292 shutdown_connections 2024-09-21T01:49:53.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.811+0000 7f3b1e09b640 1 -- 172.21.15.40:0/233225292 wait complete. 2024-09-21T01:49:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.812+0000 7f3b1e09b640 1 Processor -- start 2024-09-21T01:49:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.813+0000 7f3b1e09b640 1 -- start start 2024-09-21T01:49:53.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b1e09b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b00004800 0x7f3b18160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b1e09b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b18160880 0x7f3b1809ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b1e09b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1809efb0 0x7f3b18158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b1e09b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3b180b9960 con 0x7f3b1809efb0 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b1e09b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3b180b97e0 con 0x7f3b00004800 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b1e09b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f3b180b9ae0 con 0x7f3b18160880 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b17fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1809efb0 0x7f3b18158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b17fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1809efb0 0x7f3b18158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33552/0 (socket says 172.21.15.40:33552) 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b17fff640 1 -- 172.21.15.40:0/750840791 learned_addr learned my addr 172.21.15.40:0/750840791 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b16ffd640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b18160880 0x7f3b1809ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b177fe640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b00004800 0x7f3b18160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b17fff640 1 -- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b18160880 msgr2=0x7f3b1809ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b17fff640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b18160880 0x7f3b1809ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b17fff640 1 -- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b00004800 msgr2=0x7f3b18160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b17fff640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b00004800 0x7f3b18160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b17fff640 1 -- 172.21.15.40:0/750840791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1815cd80 con 0x7f3b1809efb0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.814+0000 7f3b17fff640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1809efb0 0x7f3b18158800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b000057e0 tx=0x7f3b10006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.815+0000 7f3afffff640 1 -- 172.21.15.40:0/750840791 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000fa20 con 0x7f3b1809efb0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.815+0000 7f3afffff640 1 -- 172.21.15.40:0/750840791 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b10018070 con 0x7f3b1809efb0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.815+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1809f730 con 0x7f3b1809efb0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.815+0000 7f3afffff640 1 -- 172.21.15.40:0/750840791 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000fe60 con 0x7f3b1809efb0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.815+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1815d300 con 0x7f3b1809efb0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.816+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1809f4a0 con 0x7f3b1809efb0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.817+0000 7f3afffff640 1 -- 172.21.15.40:0/750840791 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b10011430 con 0x7f3b1809efb0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.817+0000 7f3afffff640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b04078bc0 0x7f3b0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.817+0000 7f3afffff640 1 -- 172.21.15.40:0/750840791 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3b1009beb0 con 0x7f3b1809efb0 2024-09-21T01:49:53.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.817+0000 7f3b177fe640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b04078bc0 0x7f3b0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.818+0000 7f3b177fe640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b04078bc0 0x7f3b0407b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b1808d490 tx=0x7f3b08005ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:53.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:53.821+0000 7f3afffff640 1 -- 172.21.15.40:0/750840791 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3b10063e40 con 0x7f3b1809efb0 2024-09-21T01:49:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.009+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b18161ef0 con 0x7f3b1809efb0 2024-09-21T01:49:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.010+0000 7f3afffff640 1 -- 172.21.15.40:0/750840791 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7f3b10068870 con 0x7f3b1809efb0 2024-09-21T01:49:54.012 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:54.012 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:41.342237+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:49:37.635417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:49:38.682453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:49:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b04078bc0 msgr2=0x7f3b0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b04078bc0 0x7f3b0407b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b1808d490 tx=0x7f3b08005ef0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1809efb0 msgr2=0x7f3b18158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1809efb0 0x7f3b18158800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b000057e0 tx=0x7f3b10006720 comp rx=0 tx=0).stop 2024-09-21T01:49:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 shutdown_connections 2024-09-21T01:49:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3b04078bc0 0x7f3b0407b0d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b1809efb0 0x7f3b18158800 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3b18160880 0x7f3b1809ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 --2- 172.21.15.40:0/750840791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b00004800 0x7f3b18160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 >> 172.21.15.40:0/750840791 conn(0x7f3b1809d840 msgr2=0x7f3b180cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:54.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 shutdown_connections 2024-09-21T01:49:54.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.012+0000 7f3b1e09b640 1 -- 172.21.15.40:0/750840791 wait complete. 2024-09-21T01:49:54.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:49:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.139+0000 7f169467e640 1 -- 172.21.15.40:0/4222640262 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f168c0d2ed0 msgr2=0x7f168c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.139+0000 7f169467e640 1 --2- 172.21.15.40:0/4222640262 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f168c0d2ed0 0x7f168c0d1a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1688005fd0 tx=0x7f168802aa10 comp rx=0 tx=0).stop 2024-09-21T01:49:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.139+0000 7f169467e640 1 -- 172.21.15.40:0/4222640262 shutdown_connections 2024-09-21T01:49:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.139+0000 7f169467e640 1 --2- 172.21.15.40:0/4222640262 >> v2:172.21.15.139:3300/0 conn(0x7f168c0cf7a0 0x7f168c1626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.139+0000 7f169467e640 1 --2- 172.21.15.40:0/4222640262 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f168c0d2ed0 0x7f168c0d1a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.139+0000 7f169467e640 1 -- 172.21.15.40:0/4222640262 >> 172.21.15.40:0/4222640262 conn(0x7f168c08bfc0 msgr2=0x7f168c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.140+0000 7f169467e640 1 -- 172.21.15.40:0/4222640262 shutdown_connections 2024-09-21T01:49:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.140+0000 7f169467e640 1 -- 172.21.15.40:0/4222640262 wait complete. 2024-09-21T01:49:54.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.141+0000 7f169467e640 1 Processor -- start 2024-09-21T01:49:54.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.141+0000 7f169467e640 1 -- start start 2024-09-21T01:49:54.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.142+0000 7f169467e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f168c0b9b70 0x7f168c0a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f169467e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f168c0cf7a0 0x7f168c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f169467e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c0d2ed0 0x7f168c1f9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f169467e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f168c162da0 con 0x7f168c0cf7a0 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f169467e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f168c162c20 con 0x7f168c0d2ed0 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f169467e640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f168c162f20 con 0x7f168c0b9b70 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1691c19640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f168c0cf7a0 0x7f168c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1691c19640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f168c0cf7a0 0x7f168c0c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33566/0 (socket says 172.21.15.40:33566) 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1691c19640 1 -- 172.21.15.40:0/892093830 learned_addr learned my addr 172.21.15.40:0/892093830 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f169241a640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f168c0b9b70 0x7f168c0a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1692c1b640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c0d2ed0 0x7f168c1f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1691c19640 1 -- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f168c0b9b70 msgr2=0x7f168c0a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1691c19640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f168c0b9b70 0x7f168c0a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1691c19640 1 -- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c0d2ed0 msgr2=0x7f168c1f9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1691c19640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c0d2ed0 0x7f168c1f9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1691c19640 1 -- 172.21.15.40:0/892093830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c0c9a10 con 0x7f168c0cf7a0 2024-09-21T01:49:54.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1691c19640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f168c0cf7a0 0x7f168c0c94d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c370 tx=0x7f167c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:54.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1682ffd640 1 -- 172.21.15.40:0/892093830 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c017070 con 0x7f168c0cf7a0 2024-09-21T01:49:54.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1682ffd640 1 -- 172.21.15.40:0/892093830 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f167c0053c0 con 0x7f168c0cf7a0 2024-09-21T01:49:54.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168c0c9e90 con 0x7f168c0cf7a0 2024-09-21T01:49:54.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f1682ffd640 1 -- 172.21.15.40:0/892093830 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c003850 con 0x7f168c0cf7a0 2024-09-21T01:49:54.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.143+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168c0ca450 con 0x7f168c0cf7a0 2024-09-21T01:49:54.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.144+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f168c0c9be0 con 0x7f168c0cf7a0 2024-09-21T01:49:54.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.145+0000 7f1682ffd640 1 -- 172.21.15.40:0/892093830 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f167c01a070 con 0x7f168c0cf7a0 2024-09-21T01:49:54.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.146+0000 7f1682ffd640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1670078bc0 0x7f167007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.146+0000 7f1682ffd640 1 -- 172.21.15.40:0/892093830 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f167c09a080 con 0x7f168c0cf7a0 2024-09-21T01:49:54.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.146+0000 7f169241a640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1670078bc0 0x7f167007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.146+0000 7f169241a640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1670078bc0 0x7f167007b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1688035000 tx=0x7f1688004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:54.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.150+0000 7f1682ffd640 1 -- 172.21.15.40:0/892093830 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f167c0624b0 con 0x7f168c0cf7a0 2024-09-21T01:49:54.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.380+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f168c1634b0 con 0x7f168c0cf7a0 2024-09-21T01:49:54.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.380+0000 7f1682ffd640 1 -- 172.21.15.40:0/892093830 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f167c061db0 con 0x7f168c0cf7a0 2024-09-21T01:49:54.382 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:49:54.382 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-21T01:49:43:356671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1396929132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1396929132},{"type":"v1","addr":"172.21.15.40:6835","nonce":1396929132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/4017969431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4017969431},{"type":"v1","addr":"172.21.15.139:6836","nonce":4017969431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:49:39.729464+0000","modified":"2024-09-21T01:49:42.736647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6837/1192218063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":1192218063},{"type":"v1","addr":"172.21.15.139:6837","nonce":1192218063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T01:49:54.382 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-21T01:49:54.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1670078bc0 msgr2=0x7f167007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1670078bc0 0x7f167007b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1688035000 tx=0x7f1688004ab0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f168c0cf7a0 msgr2=0x7f168c0c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f168c0cf7a0 0x7f168c0c94d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c370 tx=0x7f167c00c830 comp rx=0 tx=0).stop 2024-09-21T01:49:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 shutdown_connections 2024-09-21T01:49:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1670078bc0 0x7f167007b0d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c0d2ed0 0x7f168c1f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f168c0cf7a0 0x7f168c0c94d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 --2- 172.21.15.40:0/892093830 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f168c0b9b70 0x7f168c0a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.382+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 >> 172.21.15.40:0/892093830 conn(0x7f168c08bfc0 msgr2=0x7f168c0d3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.383+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 shutdown_connections 2024-09-21T01:49:54.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.383+0000 7f169467e640 1 -- 172.21.15.40:0/892093830 wait complete. 2024-09-21T01:49:54.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T01:49:39.729464+0000', 'modified': '2024-09-21T01:49:42.736647+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4410}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4410': {'gid': 4410, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.139:6837/1192218063', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6835', 'nonce': 1192218063}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 1192218063}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4410, 'qdb_cluster': [4410]} 2024-09-21T01:49:54.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T01:49:54.800 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-21T01:49:54.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.921+0000 7fba69da8640 1 -- 172.21.15.40:0/3276812921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406e170 msgr2=0x7fba640b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.921+0000 7fba69da8640 1 --2- 172.21.15.40:0/3276812921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406e170 0x7fba640b3540 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba54005fd0 tx=0x7fba5402a540 comp rx=0 tx=0).stop 2024-09-21T01:49:54.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.921+0000 7fba69da8640 1 -- 172.21.15.40:0/3276812921 shutdown_connections 2024-09-21T01:49:54.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.921+0000 7fba69da8640 1 --2- 172.21.15.40:0/3276812921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406e170 0x7fba640b3540 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.921+0000 7fba69da8640 1 -- 172.21.15.40:0/3276812921 >> 172.21.15.40:0/3276812921 conn(0x7fba6408bfc0 msgr2=0x7fba6409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:54.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.922+0000 7fba69da8640 1 -- 172.21.15.40:0/3276812921 shutdown_connections 2024-09-21T01:49:54.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.922+0000 7fba69da8640 1 -- 172.21.15.40:0/3276812921 wait complete. 2024-09-21T01:49:54.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.923+0000 7fba69da8640 1 Processor -- start 2024-09-21T01:49:54.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.923+0000 7fba69da8640 1 -- start start 2024-09-21T01:49:54.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba69da8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406f4b0 0x7fba640c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba69da8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba640ceb40 0x7fba640c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba69da8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fba640cae40 0x7fba641f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba69da8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fba640d1070 con 0x7fba6406f4b0 2024-09-21T01:49:54.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba69da8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fba640d0ef0 con 0x7fba640ceb40 2024-09-21T01:49:54.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba69da8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fba640d11f0 con 0x7fba640cae40 2024-09-21T01:49:54.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406f4b0 0x7fba640c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406f4b0 0x7fba640c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33588/0 (socket says 172.21.15.40:33588) 2024-09-21T01:49:54.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba637fe640 1 -- 172.21.15.40:0/4032521389 learned_addr learned my addr 172.21.15.40:0/4032521389 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba637fe640 1 -- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fba640cae40 msgr2=0x7fba641f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba637fe640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fba640cae40 0x7fba641f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba62ffd640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba640ceb40 0x7fba640c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba637fe640 1 -- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba640ceb40 msgr2=0x7fba640c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba637fe640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba640ceb40 0x7fba640c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba637fe640 1 -- 172.21.15.40:0/4032521389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba641f5610 con 0x7fba6406f4b0 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba62ffd640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba640ceb40 0x7fba640c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.925+0000 7fba637fe640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406f4b0 0x7fba640c8200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba54006010 tx=0x7fba540039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.926+0000 7fba4bfff640 1 -- 172.21.15.40:0/4032521389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5403e030 con 0x7fba6406f4b0 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.926+0000 7fba4bfff640 1 -- 172.21.15.40:0/4032521389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba540047a0 con 0x7fba6406f4b0 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.926+0000 7fba4bfff640 1 -- 172.21.15.40:0/4032521389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54035040 con 0x7fba6406f4b0 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.926+0000 7fba69da8640 1 -- 172.21.15.40:0/4032521389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba641f58f0 con 0x7fba6406f4b0 2024-09-21T01:49:54.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.926+0000 7fba69da8640 1 -- 172.21.15.40:0/4032521389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba641f5eb0 con 0x7fba6406f4b0 2024-09-21T01:49:54.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.927+0000 7fba4bfff640 1 -- 172.21.15.40:0/4032521389 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba54041030 con 0x7fba6406f4b0 2024-09-21T01:49:54.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.928+0000 7fba4bfff640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fba50078b90 0x7fba5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.928+0000 7fba4bfff640 1 -- 172.21.15.40:0/4032521389 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fba540bb660 con 0x7fba6406f4b0 2024-09-21T01:49:54.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.928+0000 7fba62ffd640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fba50078b90 0x7fba5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.929+0000 7fba62ffd640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fba50078b90 0x7fba5007b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba640c90a0 tx=0x7fba58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:54.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.929+0000 7fba70dee740 1 Processor -- start 2024-09-21T01:49:54.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.929+0000 7fba70dee740 1 -- start start 2024-09-21T01:49:54.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.930+0000 7fba70dee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.930+0000 7fba70dee740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c8b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.930+0000 7fba70dee740 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.930+0000 7fba70dee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56010c800820 con 0x56010c4e6270 2024-09-21T01:49:54.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.930+0000 7fba70dee740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56010c7efc50 con 0x56010c4bd3b0 2024-09-21T01:49:54.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.930+0000 7fba70dee740 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x56010c7f3a60 con 0x56010c4c5590 2024-09-21T01:49:54.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.930+0000 7fba637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.930+0000 7fba637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8b7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33594/0 (socket says 172.21.15.40:33594) 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.930+0000 7fba637fe640 1 -- 172.21.15.40:0/359110136 learned_addr learned my addr 172.21.15.40:0/359110136 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba62ffd640 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c8b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba63fff640 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba637fe640 1 -- 172.21.15.40:0/359110136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 msgr2=0x56010c8d5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba637fe640 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba637fe640 1 -- 172.21.15.40:0/359110136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 msgr2=0x56010c8b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba637fe640 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c8b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba637fe640 1 -- 172.21.15.40:0/359110136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010c551850 con 0x56010c4e6270 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba63fff640 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba637fe640 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8b7fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba54083330 tx=0x7fba54082db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acf8ed276182fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba497fa640 1 -- 172.21.15.40:0/359110136 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54048030 con 0x56010c4e6270 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba497fa640 1 -- 172.21.15.40:0/359110136 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba540833a0 con 0x56010c4e6270 2024-09-21T01:49:54.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.931+0000 7fba497fa640 1 -- 172.21.15.40:0/359110136 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5408cb30 con 0x56010c4e6270 2024-09-21T01:49:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.932+0000 7fba70dee740 1 -- 172.21.15.40:0/359110136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 msgr2=0x56010c8b7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.932+0000 7fba70dee740 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8b7fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fba54083330 tx=0x7fba54082db0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.932+0000 7fba70dee740 1 -- 172.21.15.40:0/359110136 shutdown_connections 2024-09-21T01:49:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.932+0000 7fba70dee740 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.932+0000 7fba70dee740 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c8b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.932+0000 7fba70dee740 1 --2- 172.21.15.40:0/359110136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8b7fc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.932+0000 7fba70dee740 1 -- 172.21.15.40:0/359110136 >> 172.21.15.40:0/359110136 conn(0x56010c4da3c0 msgr2=0x56010c88e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.932+0000 7fba70dee740 1 -- 172.21.15.40:0/359110136 shutdown_connections 2024-09-21T01:49:54.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.932+0000 7fba70dee740 1 -- 172.21.15.40:0/359110136 wait complete. 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.933+0000 7fba70dee740 1 -- start start 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.933+0000 7fba70dee740 1 Processor -- start 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba70dee740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c8a2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba70dee740 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba70dee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba70dee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56010c560620 con 0x56010c4e6270 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba70dee740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56010c7955f0 con 0x56010c4bd3b0 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba70dee740 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x56010c8b8a40 con 0x56010c4c5590 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba70dee740 10 client.0 _ll_register_callbacks cb 0x56010c7990a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba63fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba63fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8a57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33600/0 (socket says 172.21.15.40:33600) 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba63fff640 1 -- 172.21.15.40:0/3076834444 learned_addr learned my addr 172.21.15.40:0/3076834444 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba62ffd640 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.934+0000 7fba637fe640 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c8a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba63fff640 1 -- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 msgr2=0x56010c8d69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba63fff640 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba63fff640 1 -- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 msgr2=0x56010c8a2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba63fff640 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c8a2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba63fff640 1 -- 172.21.15.40:0/3076834444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56010c5c86b0 con 0x56010c4e6270 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba62ffd640 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba63fff640 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8a57d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00c920 tx=0x7fba5c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a56579b6bca942d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba427fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba427fc640 1 -- 172.21.15.40:0/3076834444 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c008040 con 0x56010c4e6270 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba427fc640 1 -- 172.21.15.40:0/3076834444 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fba5c00a9e0 con 0x56010c4e6270 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba70dee740 1 -- 172.21.15.40:0/3076834444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba540833a0 con 0x56010c4e6270 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba427fc640 1 -- 172.21.15.40:0/3076834444 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fba5c00abe0 con 0x56010c4e6270 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba70dee740 10 client.4689 fetch_fsmap learned FSMap version 8 2024-09-21T01:49:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba70dee740 1 -- 172.21.15.40:0/3076834444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56010c8d6f00 con 0x56010c4e6270 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba427fc640 1 -- 172.21.15.40:0/3076834444 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba540833a0 con 0x56010c4e6270 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba427fc640 1 -- 172.21.15.40:0/3076834444 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fba5c00e040 con 0x56010c4e6270 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba70dee740 10 client.4689 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba70dee740 10 client.4689 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.935+0000 7fba70dee740 20 client.4689 populate_metadata read hostname 'smithi040' 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.936+0000 7fba70dee740 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] conn(0x56010c4a4e40 0x56010c8cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.936+0000 7fba70dee740 4 client.4689 mds_command: new command op to 4410 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.936+0000 7fba70dee740 1 -- 172.21.15.40:0/3076834444 --> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56010c802770 con 0x56010c4a4e40 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.936+0000 7fba637fe640 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] conn(0x56010c4a4e40 0x56010c8cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.936+0000 7fba427fc640 10 client.4689 ms_handle_connect on v2:172.21.15.139:6835/1192218063 2024-09-21T01:49:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.936+0000 7fba637fe640 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] conn(0x56010c4a4e40 0x56010c8cb2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efad3443e9d3afa4 server_cookie=7ca61f590a1162d4 in_seq=0 out_seq=0 2024-09-21T01:49:54.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba427fc640 1 -- 172.21.15.40:0/3076834444 <== mds.0 v2:172.21.15.139:6835/1192218063 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56010c802770 con 0x56010c4a4e40 2024-09-21T01:49:54.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba427fc640 10 client.4689 handle_command_reply: tid=0 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba70dee740 1 client.4689 shutdown 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba70dee740 1 -- 172.21.15.40:0/3076834444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 msgr2=0x56010c8a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba70dee740 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8a57d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00c920 tx=0x7fba5c00cde0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba70dee740 1 -- 172.21.15.40:0/3076834444 shutdown_connections 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba70dee740 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] conn(0x56010c4a4e40 0x56010c8cb2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba70dee740 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4e6270 0x56010c8a57d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba70dee740 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8d69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba427fc640 0 client.4689 ms_handle_reset on v2:172.21.15.139:6835/1192218063 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba70dee740 1 --2- 172.21.15.40:0/3076834444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c8a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.937+0000 7fba70dee740 1 -- 172.21.15.40:0/3076834444 >> 172.21.15.40:0/3076834444 conn(0x56010c4da3c0 msgr2=0x56010c8d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.938+0000 7fba70dee740 1 -- 172.21.15.40:0/3076834444 shutdown_connections 2024-09-21T01:49:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.938+0000 7fba70dee740 1 -- 172.21.15.40:0/3076834444 wait complete. 2024-09-21T01:49:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.938+0000 7fba70dee740 20 client.4689 trim_cache size 0 max 16384 2024-09-21T01:49:54.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.957+0000 7fba70dee740 1 Processor -- start 2024-09-21T01:49:54.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.957+0000 7fba70dee740 1 -- start start 2024-09-21T01:49:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba70dee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4a4e40 0x56010c887550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba70dee740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c887a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba70dee740 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba70dee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fba642013b0 con 0x56010c4a4e40 2024-09-21T01:49:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba70dee740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fba641f9380 con 0x56010c4bd3b0 2024-09-21T01:49:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba70dee740 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fba64200e80 con 0x56010c4c5590 2024-09-21T01:49:54.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4a4e40 0x56010c887550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4a4e40 0x56010c887550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33602/0 (socket says 172.21.15.40:33602) 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba637fe640 1 -- 172.21.15.40:0/2384047579 learned_addr learned my addr 172.21.15.40:0/2384047579 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba637fe640 1 -- 172.21.15.40:0/2384047579 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 msgr2=0x56010c8a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba637fe640 1 --2- 172.21.15.40:0/2384047579 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba637fe640 1 -- 172.21.15.40:0/2384047579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 msgr2=0x56010c887a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba637fe640 1 --2- 172.21.15.40:0/2384047579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c887a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba637fe640 1 -- 172.21.15.40:0/2384047579 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56010c8a64a0 con 0x56010c4a4e40 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.958+0000 7fba637fe640 1 --2- 172.21.15.40:0/2384047579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4a4e40 0x56010c887550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba540b9be0 tx=0x7fba5402a540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760b29a0d5892cde server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba48ff9640 1 -- 172.21.15.40:0/2384047579 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54048040 con 0x56010c4a4e40 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba48ff9640 1 -- 172.21.15.40:0/2384047579 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba5408c930 con 0x56010c4a4e40 2024-09-21T01:49:54.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba48ff9640 1 -- 172.21.15.40:0/2384047579 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba540a5ba0 con 0x56010c4a4e40 2024-09-21T01:49:54.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba70dee740 1 -- 172.21.15.40:0/2384047579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4a4e40 msgr2=0x56010c887550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba70dee740 1 --2- 172.21.15.40:0/2384047579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4a4e40 0x56010c887550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba540b9be0 tx=0x7fba5402a540 comp rx=0 tx=0).stop 2024-09-21T01:49:54.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba70dee740 1 -- 172.21.15.40:0/2384047579 shutdown_connections 2024-09-21T01:49:54.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba70dee740 1 --2- 172.21.15.40:0/2384047579 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c8a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba70dee740 1 --2- 172.21.15.40:0/2384047579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4bd3b0 0x56010c887a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba70dee740 1 --2- 172.21.15.40:0/2384047579 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4a4e40 0x56010c887550 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba70dee740 1 -- 172.21.15.40:0/2384047579 >> 172.21.15.40:0/2384047579 conn(0x56010c4da3c0 msgr2=0x56010c8c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:54.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba70dee740 1 -- 172.21.15.40:0/2384047579 shutdown_connections 2024-09-21T01:49:54.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.959+0000 7fba70dee740 1 -- 172.21.15.40:0/2384047579 wait complete. 2024-09-21T01:49:54.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.960+0000 7fba70dee740 1 -- start start 2024-09-21T01:49:54.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.960+0000 7fba70dee740 1 Processor -- start 2024-09-21T01:49:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba70dee740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4a4e40 0x56010c8b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba70dee740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4bd3b0 0x56010c951860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba70dee740 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c887550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba70dee740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56010c8e5410 con 0x56010c4bd3b0 2024-09-21T01:49:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba70dee740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56010c8a5d10 con 0x56010c4a4e40 2024-09-21T01:49:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba70dee740 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x56010c8e5a60 con 0x56010c4c5590 2024-09-21T01:49:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba70dee740 10 client.0 _ll_register_callbacks cb 0x7fba5c007560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:49:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4bd3b0 0x56010c951860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4bd3b0 0x56010c951860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33616/0 (socket says 172.21.15.40:33616) 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba62ffd640 1 -- 172.21.15.40:0/3847792407 learned_addr learned my addr 172.21.15.40:0/3847792407 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba63fff640 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c887550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba637fe640 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4a4e40 0x56010c8b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba62ffd640 1 -- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 msgr2=0x56010c887550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba62ffd640 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c887550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba62ffd640 1 -- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4a4e40 msgr2=0x56010c8b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba62ffd640 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4a4e40 0x56010c8b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba62ffd640 1 -- 172.21.15.40:0/3847792407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56010c8e1540 con 0x56010c4bd3b0 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba637fe640 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4a4e40 0x56010c8b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba62ffd640 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4bd3b0 0x56010c951860 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fba640b6490 tx=0x7fba58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f44a1172872149 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.962+0000 7fba427fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba427fc640 1 -- 172.21.15.40:0/3847792407 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5800dd80 con 0x56010c4bd3b0 2024-09-21T01:49:54.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba427fc640 1 -- 172.21.15.40:0/3847792407 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fba58023a80 con 0x56010c4bd3b0 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba70dee740 1 -- 172.21.15.40:0/3847792407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba5408c930 con 0x56010c4bd3b0 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba427fc640 1 -- 172.21.15.40:0/3847792407 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fba58023c80 con 0x56010c4bd3b0 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba70dee740 10 client.4695 fetch_fsmap learned FSMap version 8 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba70dee740 1 -- 172.21.15.40:0/3847792407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56010c8e5cf0 con 0x56010c4bd3b0 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba427fc640 1 -- 172.21.15.40:0/3847792407 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba5408c930 con 0x56010c4bd3b0 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba427fc640 1 -- 172.21.15.40:0/3847792407 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fba58007050 con 0x56010c4bd3b0 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba70dee740 10 client.4695 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba70dee740 10 client.4695 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba70dee740 20 client.4695 populate_metadata read hostname 'smithi040' 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba70dee740 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] conn(0x56010c47a280 0x56010c8ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba70dee740 4 client.4695 mds_command: new command op to 4410 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba70dee740 1 -- 172.21.15.40:0/3847792407 --> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] -- command(tid 0: {"prefix": "status"}) -- 0x56010c7fe220 con 0x56010c47a280 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.963+0000 7fba637fe640 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] conn(0x56010c47a280 0x56010c8ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba637fe640 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] conn(0x56010c47a280 0x56010c8ae9f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=519e4d25993dd7a8 server_cookie=9db27fe76d0edcb8 in_seq=0 out_seq=0 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba427fc640 10 client.4695 ms_handle_connect on v2:172.21.15.139:6835/1192218063 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba427fc640 1 -- 172.21.15.40:0/3847792407 <== mds.0 v2:172.21.15.139:6835/1192218063 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x56010c7fe220 con 0x56010c47a280 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba427fc640 10 client.4695 handle_command_reply: tid=0 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 client.4695 shutdown 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 -- 172.21.15.40:0/3847792407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4bd3b0 msgr2=0x56010c951860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4bd3b0 0x56010c951860 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fba640b6490 tx=0x7fba58000ed0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 -- 172.21.15.40:0/3847792407 shutdown_connections 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:6835/1192218063,v1:172.21.15.139:6837/1192218063] conn(0x56010c47a280 0x56010c8ae9f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x56010c4c5590 0x56010c887550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56010c4bd3b0 0x56010c951860 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 --2- 172.21.15.40:0/3847792407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56010c4a4e40 0x56010c8b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba427fc640 0 client.4695 ms_handle_reset on v2:172.21.15.139:6835/1192218063 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 -- 172.21.15.40:0/3847792407 >> 172.21.15.40:0/3847792407 conn(0x56010c4da3c0 msgr2=0x56010c8cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 -- 172.21.15.40:0/3847792407 shutdown_connections 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 1 -- 172.21.15.40:0/3847792407 wait complete. 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.964+0000 7fba70dee740 20 client.4695 trim_cache size 0 max 16384 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "52e0e71c-26ee-4828-88d9-740be2c186cd", 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4410, 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-21T01:49:54.971 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 14.63156802, 2024-09-21T01:49:54.972 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 8, 2024-09-21T01:49:54.972 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 21, 2024-09-21T01:49:54.972 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 21, 2024-09-21T01:49:54.972 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 20.650655004000001 2024-09-21T01:49:54.972 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 -- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fba50078b90 msgr2=0x7fba5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fba50078b90 0x7fba5007b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba640c90a0 tx=0x7fba58009040 comp rx=0 tx=0).stop 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 -- 172.21.15.40:0/4032521389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406f4b0 msgr2=0x7fba640c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406f4b0 0x7fba640c8200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba54006010 tx=0x7fba540039e0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 -- 172.21.15.40:0/4032521389 shutdown_connections 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fba50078b90 0x7fba5007b0a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fba640cae40 0x7fba641f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fba640ceb40 0x7fba640c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 --2- 172.21.15.40:0/4032521389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6406f4b0 0x7fba640c8200 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 -- 172.21.15.40:0/4032521389 >> 172.21.15.40:0/4032521389 conn(0x7fba6408bfc0 msgr2=0x7fba64068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 -- 172.21.15.40:0/4032521389 shutdown_connections 2024-09-21T01:49:54.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:54.965+0000 7fba69da8640 1 -- 172.21.15.40:0/4032521389 wait complete. 2024-09-21T01:49:54.977 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T01:49:55.001 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T01:49:55.002 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-21T01:49:55.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:55.002 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-21T01:49:55.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:55.018 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-09-21T01:49:55.086 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-09-21T01:49:55.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:49:55.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:55.088 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-21T01:49:55.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:55.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-09-21T01:49:55.210 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-09-21T01:49:55.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:49:55.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:55.211 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-21T01:49:55.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:55.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2024-09-21T01:49:55.303 INFO:teuthology.orchestra.run.smithi139.stderr:Cannot find device "ceph-brx" 2024-09-21T01:49:55.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:49:55.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:55.305 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-21T01:49:55.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:55.363 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link delete ceph-brx 2024-09-21T01:49:55.432 INFO:teuthology.orchestra.run.smithi139.stderr:Cannot find device "ceph-brx" 2024-09-21T01:49:55.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:49:55.433 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-21T01:49:55.433 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T01:49:55.434 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T01:49:55.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T01:49:55.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.550+0000 7f0977fda640 1 -- 172.21.15.40:0/3223838181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700b9be0 msgr2=0x7f09700d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:55.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.550+0000 7f0977fda640 1 --2- 172.21.15.40:0/3223838181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700b9be0 0x7f09700d4510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0960005fd0 tx=0x7f096002a5d0 comp rx=0 tx=0).stop 2024-09-21T01:49:55.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.550+0000 7f0977fda640 1 -- 172.21.15.40:0/3223838181 shutdown_connections 2024-09-21T01:49:55.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.550+0000 7f0977fda640 1 --2- 172.21.15.40:0/3223838181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700b9be0 0x7f09700d4510 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:55.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.550+0000 7f0977fda640 1 -- 172.21.15.40:0/3223838181 >> 172.21.15.40:0/3223838181 conn(0x7f097008bfc0 msgr2=0x7f097009d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:55.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.550+0000 7f0977fda640 1 -- 172.21.15.40:0/3223838181 shutdown_connections 2024-09-21T01:49:55.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.550+0000 7f0977fda640 1 -- 172.21.15.40:0/3223838181 wait complete. 2024-09-21T01:49:55.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.551+0000 7f0977fda640 1 Processor -- start 2024-09-21T01:49:55.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.551+0000 7f0977fda640 1 -- start start 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0977fda640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09700b9be0 0x7f09701ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0977fda640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09700d0ce0 0x7f09700cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0977fda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700d4a50 0x7f09700cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0977fda640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f09700b4c60 con 0x7f09700d4a50 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0977fda640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f09700b4ae0 con 0x7f09700d0ce0 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0977fda640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f09700b4de0 con 0x7f09700b9be0 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0976577640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700d4a50 0x7f09700cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0976577640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700d4a50 0x7f09700cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33634/0 (socket says 172.21.15.40:33634) 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0976577640 1 -- 172.21.15.40:0/4135028983 learned_addr learned my addr 172.21.15.40:0/4135028983 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0975575640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09700d0ce0 0x7f09700cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0975d76640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09700b9be0 0x7f09701ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:55.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0976577640 1 -- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09700b9be0 msgr2=0x7f09701ecc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0976577640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09700b9be0 0x7f09701ecc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0976577640 1 -- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09700d0ce0 msgr2=0x7f09700cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0976577640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09700d0ce0 0x7f09700cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0976577640 1 -- 172.21.15.40:0/4135028983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09700cde70 con 0x7f09700d4a50 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.553+0000 7f0976577640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700d4a50 0x7f09700cd610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f096800b9e0 tx=0x7f096800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.554+0000 7f09667fc640 1 -- 172.21.15.40:0/4135028983 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968003b70 con 0x7f09700d4a50 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.554+0000 7f09667fc640 1 -- 172.21.15.40:0/4135028983 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0968003e00 con 0x7f09700d4a50 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.554+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09701f76a0 con 0x7f09700d4a50 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.554+0000 7f09667fc640 1 -- 172.21.15.40:0/4135028983 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096800cb20 con 0x7f09700d4a50 2024-09-21T01:49:55.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.554+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09701f9200 con 0x7f09700d4a50 2024-09-21T01:49:55.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.555+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09700d4510 con 0x7f09700d4a50 2024-09-21T01:49:55.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.555+0000 7f09667fc640 1 -- 172.21.15.40:0/4135028983 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f096800ccc0 con 0x7f09700d4a50 2024-09-21T01:49:55.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.556+0000 7f09667fc640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0954078bc0 0x7f095407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:55.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.556+0000 7f09667fc640 1 -- 172.21.15.40:0/4135028983 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f096809a9e0 con 0x7f09700d4a50 2024-09-21T01:49:55.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.556+0000 7f0975d76640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0954078bc0 0x7f095407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:55.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.557+0000 7f0975d76640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0954078bc0 0x7f095407b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f096c001720 tx=0x7f096c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:55.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.560+0000 7f09667fc640 1 -- 172.21.15.40:0/4135028983 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0968062860 con 0x7f09700d4a50 2024-09-21T01:49:55.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.785+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f09700cdc00 con 0x7f09700d4a50 2024-09-21T01:49:55.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.785+0000 7f09667fc640 1 -- 172.21.15.40:0/4135028983 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f0968067290 con 0x7f09700d4a50 2024-09-21T01:49:55.787 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T01:49:55.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0954078bc0 msgr2=0x7f095407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:55.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0954078bc0 0x7f095407b0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f096c001720 tx=0x7f096c009040 comp rx=0 tx=0).stop 2024-09-21T01:49:55.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700d4a50 msgr2=0x7f09700cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:55.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700d4a50 0x7f09700cd610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f096800b9e0 tx=0x7f096800bea0 comp rx=0 tx=0).stop 2024-09-21T01:49:55.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 shutdown_connections 2024-09-21T01:49:55.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0954078bc0 0x7f095407b0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:55.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09700d4a50 0x7f09700cd610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:55.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f09700d0ce0 0x7f09700cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:55.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 --2- 172.21.15.40:0/4135028983 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f09700b9be0 0x7f09701ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:55.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.787+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 >> 172.21.15.40:0/4135028983 conn(0x7f097008bfc0 msgr2=0x7f09700b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:55.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.788+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 shutdown_connections 2024-09-21T01:49:55.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55.788+0000 7f0977fda640 1 -- 172.21.15.40:0/4135028983 wait complete. 2024-09-21T01:49:55.800 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T01:49:55.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T01:49:55.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-21T01:49:55.801 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T01:49:55.801 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T01:49:55.801 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T01:49:55.801 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T01:49:55.801 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T01:49:55.801 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:49:55.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:55.801 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-21T01:49:55.817 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:49:55.817 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:49:55.817 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:49:55.817 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:55.817 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-21T01:49:55.817 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42782sec preferred_lft 42782sec 2024-09-21T01:49:55.818 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-21T01:49:55.819 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:55.819 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:49:55.819 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:55.819 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-21T01:49:55.819 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T01:49:55.819 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:55.820 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:49:55.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-09-21T01:49:55.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-09-21T01:49:55.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-09-21T01:49:55.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T01:49:55.820 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:49:55.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:56.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:56.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:56.024 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T01:49:56.049 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-21T01:49:56.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:56.051 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-21T01:49:56.125 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-21T01:49:56.125 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T01:49:56.125 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T01:49:56.125 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T01:49:56.125 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T01:49:56.126 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:56.126 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:49:56.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T01:49:56.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T01:49:56.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T01:49:56.126 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:49:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:56.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:56.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:56.465 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-21T01:49:56.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:56.481 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-09-21T01:49:56.537 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:56.537 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:49:56.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:49:56.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T01:49:56.538 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:49:56.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:56.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:56.659 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T01:49:56.659 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:56.659 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:49:56.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T01:49:56.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T01:49:56.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T01:49:56.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T01:49:56.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T01:49:56.660 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:49:56.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:56.791 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:56.792 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:49:56.792 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-09-21T01:49:56.792 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T01:49:56.792 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:49:56.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:56.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:56.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:49:56.871 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T01:49:56.886 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:49:56.886 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:49:56.887 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:49:56.941 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T01:49:56.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:56.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:49:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:49:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:49:57.213 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:49:57.213 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:49:57.214 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.139:3300,172.21.15.139:3301" 2024-09-21T01:49:57.214 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 0@52e0e71c-26ee-4828-88d9-740be2c186cd.cephfs=/ 2024-09-21T01:49:57.214 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.40:3300/172.21.15.139:3300/172.21.15.139:3301" will pass to kernel 2024-09-21T01:49:57.215 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T01:49:57.215 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2024-09-21T01:49:57.215 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T01:49:57.215 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T01:49:57.215 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T01:49:57.216 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T01:49:57.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:57.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:49:57.242 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:49:57.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:49:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:57.347 INFO:teuthology.orchestra.run.smithi040.stdout:client4657 2024-09-21T01:49:57.347 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:57.347 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:49:57.363 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:49:57.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:49:57.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:57.468 INFO:teuthology.orchestra.run.smithi040.stdout:client4657 2024-09-21T01:49:57.469 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:49:57.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:49:57.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:57.533 INFO:teuthology.orchestra.run.smithi040.stdout:client4657 2024-09-21T01:49:57.534 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/52e0e71c-26ee-4828-88d9-740be2c186cd.client4657/status') 2024-09-21T01:49:57.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:57.599 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4657 (3)172.21.15.40:0/1549646040 2024-09-21T01:49:57.599 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2024-09-21T01:49:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2024-09-21T01:49:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2024-09-21T01:49:57.599 INFO:teuthology.orchestra.run.smithi040.stderr:70 bytes copied, 2.5521e-05 s, 2.7 MB/s 2024-09-21T01:49:57.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:57.606 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-21T01:49:57.606 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T01:49:57.606 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T01:49:57.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T01:49:57.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.722+0000 7f4e056a4640 1 -- 172.21.15.40:0/1180139937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dec004800 msgr2=0x7f4dec004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:57.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.722+0000 7f4e056a4640 1 --2- 172.21.15.40:0/1180139937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dec004800 0x7f4dec004c10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009b20 tx=0x7f4dec005830 comp rx=0 tx=0).stop 2024-09-21T01:49:57.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.722+0000 7f4e056a4640 1 -- 172.21.15.40:0/1180139937 shutdown_connections 2024-09-21T01:49:57.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.722+0000 7f4e056a4640 1 --2- 172.21.15.40:0/1180139937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4dec004800 0x7f4dec004c10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:57.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.722+0000 7f4e056a4640 1 -- 172.21.15.40:0/1180139937 >> 172.21.15.40:0/1180139937 conn(0x7f4e000b1cb0 msgr2=0x7f4e000b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:57.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.722+0000 7f4e056a4640 1 -- 172.21.15.40:0/1180139937 shutdown_connections 2024-09-21T01:49:57.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.722+0000 7f4e056a4640 1 -- 172.21.15.40:0/1180139937 wait complete. 2024-09-21T01:49:57.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.724+0000 7f4e056a4640 1 Processor -- start 2024-09-21T01:49:57.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.724+0000 7f4e056a4640 1 -- start start 2024-09-21T01:49:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.725+0000 7f4e056a4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4dec004800 0x7f4e001f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.725+0000 7f4e056a4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e001f3300 0x7f4e001f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.725+0000 7f4e056a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e000d01f0 0x7f4e000d0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.725+0000 7f4e056a4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00074a80 con 0x7f4e001f3300 2024-09-21T01:49:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.725+0000 7f4e056a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00074900 con 0x7f4e000d01f0 2024-09-21T01:49:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.725+0000 7f4e056a4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f4e00074c00 con 0x7f4dec004800 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.725+0000 7f4dfe7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e001f3300 0x7f4e001f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dfe7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e001f3300 0x7f4e001f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33654/0 (socket says 172.21.15.40:33654) 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dfe7fc640 1 -- 172.21.15.40:0/1666571862 learned_addr learned my addr 172.21.15.40:0/1666571862 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dfeffd640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4dec004800 0x7f4e001f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dff7fe640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e000d01f0 0x7f4e000d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dfe7fc640 1 -- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4dec004800 msgr2=0x7f4e001f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dfe7fc640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4dec004800 0x7f4e001f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dfe7fc640 1 -- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e000d01f0 msgr2=0x7f4e000d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dfe7fc640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e000d01f0 0x7f4e000d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dfe7fc640 1 -- 172.21.15.40:0/1666571862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e000d0b40 con 0x7f4e001f3300 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dff7fe640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e000d01f0 0x7f4e000d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4dfe7fc640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e001f3300 0x7f4e001f3710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009a70 tx=0x7f4df0033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4df77fe640 1 -- 172.21.15.40:0/1666571862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0038040 con 0x7f4e001f3300 2024-09-21T01:49:57.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4df77fe640 1 -- 172.21.15.40:0/1666571862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4df0033950 con 0x7f4e001f3300 2024-09-21T01:49:57.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e001f4080 con 0x7f4e001f3300 2024-09-21T01:49:57.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4df77fe640 1 -- 172.21.15.40:0/1666571862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0033da0 con 0x7f4e001f3300 2024-09-21T01:49:57.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.726+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e00158800 con 0x7f4e001f3300 2024-09-21T01:49:57.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.727+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e000c3860 con 0x7f4e001f3300 2024-09-21T01:49:57.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.728+0000 7f4df77fe640 1 -- 172.21.15.40:0/1666571862 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4df0043020 con 0x7f4e001f3300 2024-09-21T01:49:57.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.729+0000 7f4df77fe640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4de0078bc0 0x7f4de007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:57.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.729+0000 7f4df77fe640 1 -- 172.21.15.40:0/1666571862 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4df00baea0 con 0x7f4e001f3300 2024-09-21T01:49:57.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.729+0000 7f4dfeffd640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4de0078bc0 0x7f4de007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:57.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.730+0000 7f4dfeffd640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4de0078bc0 0x7f4de007b0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e00052910 tx=0x7f4de8006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:57.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.734+0000 7f4df77fe640 1 -- 172.21.15.40:0/1666571862 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4df004a020 con 0x7f4e001f3300 2024-09-21T01:49:57.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.960+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4e0006ddf0 con 0x7f4e001f3300 2024-09-21T01:49:57.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.960+0000 7f4df77fe640 1 -- 172.21.15.40:0/1666571862 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f4e000d0b40 con 0x7f4e001f3300 2024-09-21T01:49:57.962 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T01:49:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.962+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4de0078bc0 msgr2=0x7f4de007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4de0078bc0 0x7f4de007b0d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e00052910 tx=0x7f4de8006b70 comp rx=0 tx=0).stop 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e001f3300 msgr2=0x7f4e001f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e001f3300 0x7f4e001f3710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009a70 tx=0x7f4df0033670 comp rx=0 tx=0).stop 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 shutdown_connections 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4de0078bc0 0x7f4de007b0d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4e000d01f0 0x7f4e000d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e001f3300 0x7f4e001f3710 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 --2- 172.21.15.40:0/1666571862 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4dec004800 0x7f4e001f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 >> 172.21.15.40:0/1666571862 conn(0x7f4e000b1cb0 msgr2=0x7f4e0015acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 shutdown_connections 2024-09-21T01:49:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:57.963+0000 7f4e056a4640 1 -- 172.21.15.40:0/1666571862 wait complete. 2024-09-21T01:49:57.975 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T01:49:57.976 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T01:49:57.976 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-21T01:49:57.976 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-21T01:49:57.976 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T01:49:57.976 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T01:49:57.976 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T01:49:57.976 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T01:49:57.976 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-21T01:49:57.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:57.976 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-21T01:49:57.992 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:49:57.992 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:49:57.992 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:49:57.992 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:57.992 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-21T01:49:57.992 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42780sec preferred_lft 42780sec 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-21T01:49:57.993 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 1a:57:57:c5:8d:7f brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::7069:13ff:fed7:c068/64 scope link 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:57.994 INFO:teuthology.orchestra.run.smithi040.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T01:49:57.995 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 1a:57:57:c5:8d:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:49:57.995 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::1857:57ff:fec5:8d7f/64 scope link tentative 2024-09-21T01:49:57.995 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:57.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:57.995 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T01:49:58.056 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-21T01:49:58.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:58.058 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-21T01:49:58.115 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-21T01:49:58.115 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T01:49:58.115 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T01:49:58.115 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T01:49:58.115 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T01:49:58.116 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:58.116 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:49:58.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T01:49:58.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T01:49:58.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T01:49:58.116 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:49:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:58.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:58.244 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-21T01:49:58.259 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T01:49:58.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:58.260 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-09-21T01:49:58.315 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-21T01:49:58.315 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:58.315 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:49:58.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T01:49:58.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-21T01:49:58.316 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:49:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:58.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:58.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:58.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T01:49:58.463 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:49:58.463 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:49:58.463 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:49:58.463 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:58.463 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-21T01:49:58.463 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:58.463 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T01:49:58.463 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 3e:83:88:56:f8:1d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T01:49:58.464 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T01:49:58.464 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:58.464 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::3c83:88ff:fe56:f81d/64 scope link tentative 2024-09-21T01:49:58.464 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:58.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:58.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 3e:83:88:56:f8:1d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T01:49:58.531 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:58.532 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::3c83:88ff:fe56:f81d/64 scope link tentative 2024-09-21T01:49:58.532 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:58.533 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-21T01:49:58.533 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:58.533 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:49:58.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-21T01:49:58.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T01:49:58.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-21T01:49:58.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-21T01:49:58.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-21T01:49:58.533 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:49:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:58.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:58.689 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:58.689 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:49:58.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2024-09-21T01:49:58.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T01:49:58.689 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:49:58.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:58.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:58.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:49:58.768 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-21T01:49:58.783 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-21T01:49:58.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:49:58.783 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-21T01:49:58.839 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-21T01:49:58.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:58.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:49:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:49:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:49:58.944 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:49:58.944 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:49:58.944 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.139:3300,172.21.15.139:3301" 2024-09-21T01:49:58.944 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 2@52e0e71c-26ee-4828-88d9-740be2c186cd.cephfs=/ 2024-09-21T01:49:58.945 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.40:3300/172.21.15.139:3300/172.21.15.139:3301" will pass to kernel 2024-09-21T01:49:58.945 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-21T01:49:58.945 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2024-09-21T01:49:58.945 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T01:49:58.945 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T01:49:58.945 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T01:49:58.947 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T01:49:58.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:58.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-21T01:49:58.972 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:49:59.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:49:59.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:59.070 INFO:teuthology.orchestra.run.smithi040.stdout:client4713 2024-09-21T01:49:59.070 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:49:59.070 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:49:59.086 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:49:59.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:49:59.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:59.183 INFO:teuthology.orchestra.run.smithi040.stdout:client4713 2024-09-21T01:49:59.183 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:49:59.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:49:59.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:59.240 INFO:teuthology.orchestra.run.smithi040.stdout:client4713 2024-09-21T01:49:59.240 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/52e0e71c-26ee-4828-88d9-740be2c186cd.client4713/status') 2024-09-21T01:49:59.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:59.299 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4713 (3)192.168.0.2:0/4156984520 2024-09-21T01:49:59.300 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2024-09-21T01:49:59.300 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2024-09-21T01:49:59.300 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2024-09-21T01:49:59.300 INFO:teuthology.orchestra.run.smithi040.stderr:69 bytes copied, 2.4962e-05 s, 2.8 MB/s 2024-09-21T01:49:59.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:59.307 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-21T01:49:59.307 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T01:49:59.307 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T01:49:59.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T01:49:59.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.422+0000 7f44b0484640 1 -- 172.21.15.40:0/865150642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4494003a00 msgr2=0x7f4494003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:59.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.422+0000 7f44b0484640 1 --2- 172.21.15.40:0/865150642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4494003a00 0x7f4494003e70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009b40 tx=0x7f4494005830 comp rx=0 tx=0).stop 2024-09-21T01:49:59.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.422+0000 7f44aea21640 1 -- 172.21.15.40:0/865150642 reap_dead start 2024-09-21T01:49:59.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.423+0000 7f44b0484640 1 -- 172.21.15.40:0/865150642 shutdown_connections 2024-09-21T01:49:59.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.423+0000 7f44b0484640 1 -- 172.21.15.40:0/865150642 >> 172.21.15.40:0/865150642 conn(0x7f44a809d7f0 msgr2=0x7f44a80d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:59.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.423+0000 7f44b0484640 1 -- 172.21.15.40:0/865150642 shutdown_connections 2024-09-21T01:49:59.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.423+0000 7f44b0484640 1 -- 172.21.15.40:0/865150642 wait complete. 2024-09-21T01:49:59.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.424+0000 7f44b0484640 1 Processor -- start 2024-09-21T01:49:59.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.424+0000 7f44b0484640 1 -- start start 2024-09-21T01:49:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44b0484640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4494003a00 0x7f44a81f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44b0484640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44a8150650 0x7f44a8160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44b0484640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44a81f6070 0x7f44a80b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44b0484640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f44a806f270 con 0x7f44a81f6070 2024-09-21T01:49:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44b0484640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f44a806f0f0 con 0x7f44a8150650 2024-09-21T01:49:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44b0484640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f44a806f3f0 con 0x7f4494003a00 2024-09-21T01:49:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44aea21640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44a81f6070 0x7f44a80b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44aea21640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44a81f6070 0x7f44a80b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33666/0 (socket says 172.21.15.40:33666) 2024-09-21T01:49:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44aea21640 1 -- 172.21.15.40:0/3951465531 learned_addr learned my addr 172.21.15.40:0/3951465531 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44ada1f640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44a8150650 0x7f44a8160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44ae220640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4494003a00 0x7f44a81f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44aea21640 1 -- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4494003a00 msgr2=0x7f44a81f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44aea21640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4494003a00 0x7f44a81f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44aea21640 1 -- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44a8150650 msgr2=0x7f44a8160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44aea21640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44a8150650 0x7f44a8160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44aea21640 1 -- 172.21.15.40:0/3951465531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a8161470 con 0x7f44a81f6070 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f44aea21640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44a81f6070 0x7f44a80b24d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f44a80c7ff0 tx=0x7f44a0006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f449effd640 1 -- 172.21.15.40:0/3951465531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a000fc10 con 0x7f44a81f6070 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.426+0000 7f449effd640 1 -- 172.21.15.40:0/3951465531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44a000fdf0 con 0x7f44a81f6070 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.427+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a81f5890 con 0x7f44a81f6070 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.427+0000 7f449effd640 1 -- 172.21.15.40:0/3951465531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a0011690 con 0x7f44a81f6070 2024-09-21T01:49:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.427+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a81510d0 con 0x7f44a81f6070 2024-09-21T01:49:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.427+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a80b63b0 con 0x7f44a81f6070 2024-09-21T01:49:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.428+0000 7f449effd640 1 -- 172.21.15.40:0/3951465531 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44a0018020 con 0x7f44a81f6070 2024-09-21T01:49:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.429+0000 7f449effd640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f448c078bc0 0x7f448c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:49:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.429+0000 7f449effd640 1 -- 172.21.15.40:0/3951465531 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f44a009b8c0 con 0x7f44a81f6070 2024-09-21T01:49:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.429+0000 7f44ae220640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f448c078bc0 0x7f448c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:49:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.430+0000 7f44ae220640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f448c078bc0 0x7f448c07b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009b40 tx=0x7f44a40046c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:49:59.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.434+0000 7f449effd640 1 -- 172.21.15.40:0/3951465531 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f44a0015030 con 0x7f44a81f6070 2024-09-21T01:49:59.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.661+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f44a8150b80 con 0x7f44a81f6070 2024-09-21T01:49:59.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.661+0000 7f449effd640 1 -- 172.21.15.40:0/3951465531 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f44a80b68f0 con 0x7f44a81f6070 2024-09-21T01:49:59.663 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T01:49:59.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f448c078bc0 msgr2=0x7f448c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:59.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f448c078bc0 0x7f448c07b0d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009b40 tx=0x7f44a40046c0 comp rx=0 tx=0).stop 2024-09-21T01:49:59.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44a81f6070 msgr2=0x7f44a80b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:49:59.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44a81f6070 0x7f44a80b24d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f44a80c7ff0 tx=0x7f44a0006720 comp rx=0 tx=0).stop 2024-09-21T01:49:59.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 shutdown_connections 2024-09-21T01:49:59.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f448c078bc0 0x7f448c07b0d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:59.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44a81f6070 0x7f44a80b24d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:59.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44a8150650 0x7f44a8160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:59.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 --2- 172.21.15.40:0/3951465531 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4494003a00 0x7f44a81f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:49:59.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.663+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 >> 172.21.15.40:0/3951465531 conn(0x7f44a809d7f0 msgr2=0x7f44a815e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:49:59.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.664+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 shutdown_connections 2024-09-21T01:49:59.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:49:59.664+0000 7f44b0484640 1 -- 172.21.15.40:0/3951465531 wait complete. 2024-09-21T01:49:59.676 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T01:49:59.676 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T01:49:59.676 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2024-09-21T01:49:59.676 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T01:49:59.676 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T01:49:59.676 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T01:49:59.676 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T01:49:59.676 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T01:49:59.676 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T01:49:59.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:59.677 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2024-09-21T01:49:59.695 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:49:59.695 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f0 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f1 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T01:49:59.696 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:49:59.697 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T01:49:59.697 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42777sec preferred_lft 42777sec 2024-09-21T01:49:59.697 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::ec4:7aff:fe88:7f59/64 scope link noprefixroute 2024-09-21T01:49:59.697 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:49:59.697 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T01:49:59.697 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:49:59.697 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-21T01:49:59.697 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add name ceph-brx type bridge 2024-09-21T01:49:59.697 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr flush dev ceph-brx 2024-09-21T01:49:59.697 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set ceph-brx up 2024-09-21T01:49:59.697 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T01:49:59.698 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-21T01:49:59.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:49:59.898 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:49:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:49:59.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:59.904 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T01:49:59.929 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-21T01:49:59.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:49:59.930 DEBUG:teuthology.orchestra.run.smithi139:> route 2024-09-21T01:50:00.000 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2024-09-21T01:50:00.000 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T01:50:00.000 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T01:50:00.000 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T01:50:00.000 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T01:50:00.001 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:50:00.001 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-21T01:50:00.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T01:50:00.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T01:50:00.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T01:50:00.001 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-21T01:50:00.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:00.315 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:00.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:00.321 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-21T01:50:00.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:00.336 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2024-09-21T01:50:00.391 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:50:00.391 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-21T01:50:00.391 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T01:50:00.391 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T01:50:00.391 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-21T01:50:00.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:00.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:00.511 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T01:50:00.511 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:50:00.511 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-21T01:50:00.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T01:50:00.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T01:50:00.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T01:50:00.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T01:50:00.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T01:50:00.511 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-21T01:50:00.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:00.662 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:00.668 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:50:00.668 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-21T01:50:00.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.0 up 2024-09-21T01:50:00.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T01:50:00.668 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-21T01:50:00.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:00.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:00.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:50:00.745 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T01:50:00.760 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T01:50:00.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:50:00.760 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T01:50:00.815 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T01:50:00.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:00.815 DEBUG:teuthology.orchestra.run.smithi139:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:50:00.923 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:50:00.923 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:50:01.050 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:50:01.050 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:50:01.050 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.139:3300,172.21.15.139:3301" 2024-09-21T01:50:01.050 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: trying mount with new device syntax: 1@52e0e71c-26ee-4828-88d9-740be2c186cd.cephfs=/ 2024-09-21T01:50:01.050 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.40:3300/172.21.15.139:3300/172.21.15.139:3301" will pass to kernel 2024-09-21T01:50:01.050 INFO:teuthology.orchestra.run.smithi139.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T01:50:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: You just mounted a file system that supports labels which does not 2024-09-21T01:50:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T01:50:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T01:50:01.051 INFO:teuthology.orchestra.run.smithi139.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T01:50:01.052 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T01:50:01.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:01.052 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T01:50:01.082 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:50:01.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:50:01.171 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:01.177 INFO:teuthology.orchestra.run.smithi139.stdout:client4675 2024-09-21T01:50:01.177 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:50:01.177 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:01.193 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:50:01.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:50:01.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:01.289 INFO:teuthology.orchestra.run.smithi139.stdout:client4675 2024-09-21T01:50:01.289 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:50:01.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:50:01.340 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:01.345 INFO:teuthology.orchestra.run.smithi139.stdout:client4675 2024-09-21T01:50:01.346 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/52e0e71c-26ee-4828-88d9-740be2c186cd.client4675/status') 2024-09-21T01:50:01.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:01.405 INFO:teuthology.orchestra.run.smithi139.stdout:instance: client.4675 (3)192.168.0.1:0/2815892639 2024-09-21T01:50:01.405 INFO:teuthology.orchestra.run.smithi139.stdout:blocklisted: false 2024-09-21T01:50:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records in 2024-09-21T01:50:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records out 2024-09-21T01:50:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:69 bytes copied, 2.2437e-05 s, 3.1 MB/s 2024-09-21T01:50:01.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:01.413 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-21T01:50:01.413 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T01:50:01.413 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T01:50:01.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T01:50:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.546+0000 7fb4e8af2640 1 -- 172.21.15.40:0/160168592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 msgr2=0x7fb4e40ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.546+0000 7fb4e8af2640 1 --2- 172.21.15.40:0/160168592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 0x7fb4e40ceb50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4070810 tx=0x7fb4cc02a560 comp rx=0 tx=0).stop 2024-09-21T01:50:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.546+0000 7fb4e8af2640 1 -- 172.21.15.40:0/160168592 shutdown_connections 2024-09-21T01:50:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.546+0000 7fb4e8af2640 1 --2- 172.21.15.40:0/160168592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 0x7fb4e40ceb50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.546+0000 7fb4e8af2640 1 --2- 172.21.15.40:0/160168592 >> v2:172.21.15.139:3300/0 conn(0x7fb4e40d1d40 0x7fb4e40b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.546+0000 7fb4e8af2640 1 -- 172.21.15.40:0/160168592 >> 172.21.15.40:0/160168592 conn(0x7fb4e40b3f10 msgr2=0x7fb4e40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.546+0000 7fb4e8af2640 1 -- 172.21.15.40:0/160168592 shutdown_connections 2024-09-21T01:50:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.546+0000 7fb4e8af2640 1 -- 172.21.15.40:0/160168592 wait complete. 2024-09-21T01:50:01.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.548+0000 7fb4e8af2640 1 Processor -- start 2024-09-21T01:50:01.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.548+0000 7fb4e8af2640 1 -- start start 2024-09-21T01:50:01.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.549+0000 7fb4e8af2640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb4e40ccba0 0x7fb4e40cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:01.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.549+0000 7fb4e8af2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4e40d1d40 0x7fb4e414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:01.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.549+0000 7fb4e8af2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 0x7fb4e414d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:01.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.549+0000 7fb4e8af2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e40d11f0 con 0x7fb4e415c6f0 2024-09-21T01:50:01.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.549+0000 7fb4e8af2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e40d1070 con 0x7fb4e40d1d40 2024-09-21T01:50:01.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.549+0000 7fb4e8af2640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e40d1370 con 0x7fb4e40ccba0 2024-09-21T01:50:01.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.549+0000 7fb4e2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 0x7fb4e414d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:01.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.549+0000 7fb4e2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 0x7fb4e414d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59530/0 (socket says 172.21.15.40:59530) 2024-09-21T01:50:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.549+0000 7fb4e2d9d640 1 -- 172.21.15.40:0/3470764548 learned_addr learned my addr 172.21.15.40:0/3470764548 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4dbfff640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4e40d1d40 0x7fb4e414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4e259c640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb4e40ccba0 0x7fb4e40cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4e2d9d640 1 -- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb4e40ccba0 msgr2=0x7fb4e40cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4e2d9d640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb4e40ccba0 0x7fb4e40cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4e2d9d640 1 -- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4e40d1d40 msgr2=0x7fb4e414d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4e2d9d640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4e40d1d40 0x7fb4e414d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4e2d9d640 1 -- 172.21.15.40:0/3470764548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e406e9a0 con 0x7fb4e415c6f0 2024-09-21T01:50:01.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4e2d9d640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 0x7fb4e414d830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00b9a0 tx=0x7fb4dc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4daffd640 1 -- 172.21.15.40:0/3470764548 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc019070 con 0x7fb4e415c6f0 2024-09-21T01:50:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4daffd640 1 -- 172.21.15.40:0/3470764548 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4dc00cc90 con 0x7fb4e415c6f0 2024-09-21T01:50:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4daffd640 1 -- 172.21.15.40:0/3470764548 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0146a0 con 0x7fb4e415c6f0 2024-09-21T01:50:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e406ec80 con 0x7fb4e415c6f0 2024-09-21T01:50:01.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.550+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e406f240 con 0x7fb4e415c6f0 2024-09-21T01:50:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.551+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e414d010 con 0x7fb4e415c6f0 2024-09-21T01:50:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.552+0000 7fb4daffd640 1 -- 172.21.15.40:0/3470764548 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb4dc01c070 con 0x7fb4e415c6f0 2024-09-21T01:50:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.552+0000 7fb4daffd640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb4c4078b90 0x7fb4c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.553+0000 7fb4daffd640 1 -- 172.21.15.40:0/3470764548 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb4dc09a9c0 con 0x7fb4e415c6f0 2024-09-21T01:50:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.553+0000 7fb4e259c640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb4c4078b90 0x7fb4c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.553+0000 7fb4e259c640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb4c4078b90 0x7fb4c407b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4004630 tx=0x7fb4d400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.557+0000 7fb4daffd640 1 -- 172.21.15.40:0/3470764548 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb4e414d010 con 0x7fb4e415c6f0 2024-09-21T01:50:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.783+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb4e40add00 con 0x7fb4e415c6f0 2024-09-21T01:50:01.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.783+0000 7fb4daffd640 1 -- 172.21.15.40:0/3470764548 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fb4dc062710 con 0x7fb4e415c6f0 2024-09-21T01:50:01.784 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb4c4078b90 msgr2=0x7fb4c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb4c4078b90 0x7fb4c407b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4004630 tx=0x7fb4d400b2e0 comp rx=0 tx=0).stop 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 msgr2=0x7fb4e414d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 0x7fb4e414d830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00b9a0 tx=0x7fb4dc00be60 comp rx=0 tx=0).stop 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 shutdown_connections 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb4c4078b90 0x7fb4c407b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4e415c6f0 0x7fb4e414d830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb4e40d1d40 0x7fb4e414d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 --2- 172.21.15.40:0/3470764548 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb4e40ccba0 0x7fb4e40cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 >> 172.21.15.40:0/3470764548 conn(0x7fb4e40b3f10 msgr2=0x7fb4e40b7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:01.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 shutdown_connections 2024-09-21T01:50:01.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:01.786+0000 7fb4e8af2640 1 -- 172.21.15.40:0/3470764548 wait complete. 2024-09-21T01:50:01.798 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T01:50:01.798 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T01:50:01.798 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi139.front.sepia.ceph.com 2024-09-21T01:50:01.798 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-21T01:50:01.798 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T01:50:01.798 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T01:50:01.798 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T01:50:01.798 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T01:50:01.798 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-21T01:50:01.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:01.799 DEBUG:teuthology.orchestra.run.smithi139:> ip addr 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e8 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f0 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:50:01.815 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:d9:36:e9 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: altname enp7s0f1 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:58 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether 0c:c4:7a:88:7f:59 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: inet 172.21.15.139/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft 42775sec preferred_lft 42775sec 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::ec4:7aff:fe88:7f59/64 scope link noprefixroute 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether d6:41:84:ba:22:59 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:01.816 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::2ca5:d0ff:fe3d:c167/64 scope link 2024-09-21T01:50:01.817 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:01.817 INFO:teuthology.orchestra.run.smithi139.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T01:50:01.817 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether d6:41:84:ba:22:59 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T01:50:01.817 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::d441:84ff:feba:2259/64 scope link tentative 2024-09-21T01:50:01.817 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:01.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:01.817 DEBUG:teuthology.orchestra.run.smithi139:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T01:50:01.879 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-21T01:50:01.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:01.880 DEBUG:teuthology.orchestra.run.smithi139:> route 2024-09-21T01:50:01.937 INFO:teuthology.orchestra.run.smithi139.stdout:Kernel IP routing table 2024-09-21T01:50:01.937 INFO:teuthology.orchestra.run.smithi139.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T01:50:01.937 INFO:teuthology.orchestra.run.smithi139.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T01:50:01.937 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T01:50:01.937 INFO:teuthology.orchestra.run.smithi139.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T01:50:01.937 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:50:01.937 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-21T01:50:01.938 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T01:50:01.938 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T01:50:01.938 DEBUG:teuthology.orchestra.run.smithi139:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T01:50:01.938 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-21T01:50:02.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:02.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:02.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:02.063 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list 2024-09-21T01:50:02.078 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T01:50:02.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:02.079 DEBUG:teuthology.orchestra.run.smithi139:> ip netns list-id 2024-09-21T01:50:02.137 INFO:teuthology.orchestra.run.smithi139.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-21T01:50:02.137 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:50:02.138 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-21T01:50:02.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T01:50:02.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-21T01:50:02.138 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-21T01:50:02.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:02.248 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:02.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:02.254 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether a6:0d:d4:0c:4d:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:02.279 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::a40d:d4ff:fe0c:4d18/64 scope link tentative 2024-09-21T01:50:02.280 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:02.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:02.280 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T01:50:02.345 INFO:teuthology.orchestra.run.smithi139.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:50:02.345 INFO:teuthology.orchestra.run.smithi139.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:50:02.345 INFO:teuthology.orchestra.run.smithi139.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:50:02.345 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:02.345 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 ::1/128 scope host 2024-09-21T01:50:02.345 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:02.345 INFO:teuthology.orchestra.run.smithi139.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T01:50:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: link/ether a6:0d:d4:0c:4d:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T01:50:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T01:50:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: inet6 fe80::a40d:d4ff:fe0c:4d18/64 scope link tentative 2024-09-21T01:50:02.346 INFO:teuthology.orchestra.run.smithi139.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:02.347 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-21T01:50:02.347 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:50:02.347 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-21T01:50:02.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-21T01:50:02.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T01:50:02.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-21T01:50:02.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-21T01:50:02.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-21T01:50:02.347 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-21T01:50:02.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:02.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:02.498 DEBUG:teuthology.orchestra.run.smithi139:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:50:02.498 DEBUG:teuthology.orchestra.run.smithi139:> set -e 2024-09-21T01:50:02.499 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set brx.1 up 2024-09-21T01:50:02.499 DEBUG:teuthology.orchestra.run.smithi139:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T01:50:02.499 DEBUG:teuthology.orchestra.run.smithi139:> ') 2024-09-21T01:50:02.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:02.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:02.574 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:50:02.575 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-21T01:50:02.589 INFO:teuthology.orchestra.run.smithi139.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-21T01:50:02.589 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:50:02.590 DEBUG:teuthology.orchestra.run.smithi139:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-21T01:50:02.644 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-21T01:50:02.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:02.645 DEBUG:teuthology.orchestra.run.smithi139:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:50:02.739 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:50:02.739 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:50:02.747 INFO:teuthology.orchestra.run.smithi139.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:50:02.747 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:50:02.747 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.139:3300,172.21.15.139:3301" 2024-09-21T01:50:02.747 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: trying mount with new device syntax: 3@52e0e71c-26ee-4828-88d9-740be2c186cd.cephfs=/ 2024-09-21T01:50:02.747 INFO:teuthology.orchestra.run.smithi139.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.40:3300/172.21.15.139:3300/172.21.15.139:3301" will pass to kernel 2024-09-21T01:50:02.748 INFO:teuthology.orchestra.run.smithi139.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-21T01:50:02.748 INFO:teuthology.orchestra.run.smithi139.stdout: You just mounted a file system that supports labels which does not 2024-09-21T01:50:02.748 INFO:teuthology.orchestra.run.smithi139.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T01:50:02.748 INFO:teuthology.orchestra.run.smithi139.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T01:50:02.748 INFO:teuthology.orchestra.run.smithi139.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T01:50:02.749 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T01:50:02.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:02.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-21T01:50:02.774 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:50:02.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:50:02.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:02.869 INFO:teuthology.orchestra.run.smithi139.stdout:client4502 2024-09-21T01:50:02.869 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:50:02.869 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:02.885 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:50:02.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:50:02.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:02.980 INFO:teuthology.orchestra.run.smithi139.stdout:client4502 2024-09-21T01:50:02.980 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:50:03.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:50:03.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:03.035 INFO:teuthology.orchestra.run.smithi139.stdout:client4502 2024-09-21T01:50:03.036 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/52e0e71c-26ee-4828-88d9-740be2c186cd.client4502/status') 2024-09-21T01:50:03.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:03.093 INFO:teuthology.orchestra.run.smithi139.stdout:instance: client.4502 (3)192.168.0.2:0/3274269147 2024-09-21T01:50:03.093 INFO:teuthology.orchestra.run.smithi139.stdout:blocklisted: false 2024-09-21T01:50:03.093 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records in 2024-09-21T01:50:03.093 INFO:teuthology.orchestra.run.smithi139.stderr:0+1 records out 2024-09-21T01:50:03.093 INFO:teuthology.orchestra.run.smithi139.stderr:69 bytes copied, 2.2559e-05 s, 3.1 MB/s 2024-09-21T01:50:03.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-21T01:50:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:03.100 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-21T01:50:03.961 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-09-21T01:50:03.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:50:04.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.092+0000 7f0f11ebd640 1 -- 172.21.15.40:0/1055776850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0706c0 msgr2=0x7f0f0c072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.092+0000 7f0f11ebd640 1 --2- 172.21.15.40:0/1055776850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0706c0 0x7f0f0c072ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0b4f90 tx=0x7f0f0402a820 comp rx=0 tx=0).stop 2024-09-21T01:50:04.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.092+0000 7f0f11ebd640 1 -- 172.21.15.40:0/1055776850 shutdown_connections 2024-09-21T01:50:04.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.092+0000 7f0f11ebd640 1 --2- 172.21.15.40:0/1055776850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0706c0 0x7f0f0c072ff0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.092+0000 7f0f11ebd640 1 --2- 172.21.15.40:0/1055776850 >> v2:172.21.15.139:3300/0 conn(0x7f0f0c0cd3e0 0x7f0f0c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.092+0000 7f0f11ebd640 1 -- 172.21.15.40:0/1055776850 >> 172.21.15.40:0/1055776850 conn(0x7f0f0c06d7d0 msgr2=0x7f0f0c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:04.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.092+0000 7f0f11ebd640 1 -- 172.21.15.40:0/1055776850 shutdown_connections 2024-09-21T01:50:04.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.092+0000 7f0f11ebd640 1 -- 172.21.15.40:0/1055776850 wait complete. 2024-09-21T01:50:04.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.094+0000 7f0f11ebd640 1 Processor -- start 2024-09-21T01:50:04.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.094+0000 7f0f11ebd640 1 -- start start 2024-09-21T01:50:04.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f11ebd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f0c0706c0 0x7f0f0c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f11ebd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0f0c0af780 0x7f0f0c14c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f11ebd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0cd3e0 0x7f0f0c1e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f11ebd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c073b20 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f11ebd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c0739a0 con 0x7f0f0c0706c0 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f11ebd640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0c073ca0 con 0x7f0f0c0af780 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0cd3e0 0x7f0f0c1e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0cd3e0 0x7f0f0c1e6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59548/0 (socket says 172.21.15.40:59548) 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0bfff640 1 -- 172.21.15.40:0/3529370705 learned_addr learned my addr 172.21.15.40:0/3529370705 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0affd640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0f0c0af780 0x7f0f0c14c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0b7fe640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f0c0706c0 0x7f0f0c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0bfff640 1 -- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0f0c0af780 msgr2=0x7f0f0c14c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0bfff640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0f0c0af780 0x7f0f0c14c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0bfff640 1 -- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f0c0706c0 msgr2=0x7f0f0c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0bfff640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f0c0706c0 0x7f0f0c159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0bfff640 1 -- 172.21.15.40:0/3529370705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c1f7bc0 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0b7fe640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f0c0706c0 0x7f0f0c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:04.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0f0bfff640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0cd3e0 0x7f0f0c1e6a10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009b30 tx=0x7f0f04032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:04.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.096+0000 7f0ef3fff640 1 -- 172.21.15.40:0/3529370705 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04037040 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.097+0000 7f0ef3fff640 1 -- 172.21.15.40:0/3529370705 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f04042070 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.097+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0c1f7040 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.097+0000 7f0ef3fff640 1 -- 172.21.15.40:0/3529370705 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04004280 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.097+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0c1f7600 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.098+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0c1f3690 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.098+0000 7f0ef3fff640 1 -- 172.21.15.40:0/3529370705 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f04004420 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.099+0000 7f0ef3fff640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0ef8078b90 0x7f0ef807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.099+0000 7f0ef3fff640 1 -- 172.21.15.40:0/3529370705 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f040bbbb0 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.099+0000 7f0f0b7fe640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0ef8078b90 0x7f0ef807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.100+0000 7f0f0b7fe640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0ef8078b90 0x7f0ef807b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0016a0 tx=0x7f0efc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:04.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.103+0000 7f0ef3fff640 1 -- 172.21.15.40:0/3529370705 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0f04084140 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.293+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f0c1f6dd0 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.294+0000 7f0ef3fff640 1 -- 172.21.15.40:0/3529370705 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7f0f04083a40 con 0x7f0f0c0cd3e0 2024-09-21T01:50:04.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:04.295 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:41.342237+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:49:37.635417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:49:38.682453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:50:04.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.296+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0ef8078b90 msgr2=0x7f0ef807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.296+0000 7f0f11ebd640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0ef8078b90 0x7f0ef807b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0016a0 tx=0x7f0efc009040 comp rx=0 tx=0).stop 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.296+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0cd3e0 msgr2=0x7f0f0c1e6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.296+0000 7f0f11ebd640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0cd3e0 0x7f0f0c1e6a10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009b30 tx=0x7f0f04032c90 comp rx=0 tx=0).stop 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.297+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 shutdown_connections 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.297+0000 7f0f11ebd640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0ef8078b90 0x7f0ef807b0a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.297+0000 7f0f11ebd640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f0c0cd3e0 0x7f0f0c1e6a10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.297+0000 7f0f11ebd640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0f0c0af780 0x7f0f0c14c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.297+0000 7f0f11ebd640 1 --2- 172.21.15.40:0/3529370705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f0c0706c0 0x7f0f0c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.297+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 >> 172.21.15.40:0/3529370705 conn(0x7f0f0c06d7d0 msgr2=0x7f0f0c09d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.297+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 shutdown_connections 2024-09-21T01:50:04.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.297+0000 7f0f11ebd640 1 -- 172.21.15.40:0/3529370705 wait complete. 2024-09-21T01:50:04.309 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T01:49:27.357546+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T01:49:37.635417+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T01:49:38.682453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:50:04.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T01:50:04.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.431+0000 7f826d798640 1 -- 172.21.15.40:0/1222288484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 msgr2=0x7f82681662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.431+0000 7f826d798640 1 --2- 172.21.15.40:0/1222288484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 0x7f82681662c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8258009830 tx=0x7f825802a510 comp rx=0 tx=0).stop 2024-09-21T01:50:04.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.431+0000 7f826d798640 1 -- 172.21.15.40:0/1222288484 shutdown_connections 2024-09-21T01:50:04.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.431+0000 7f826d798640 1 --2- 172.21.15.40:0/1222288484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 0x7f82681662c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.431+0000 7f826d798640 1 -- 172.21.15.40:0/1222288484 >> 172.21.15.40:0/1222288484 conn(0x7f826806def0 msgr2=0x7f826806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:04.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.431+0000 7f826d798640 1 -- 172.21.15.40:0/1222288484 shutdown_connections 2024-09-21T01:50:04.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.431+0000 7f826d798640 1 -- 172.21.15.40:0/1222288484 wait complete. 2024-09-21T01:50:04.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.433+0000 7f826d798640 1 Processor -- start 2024-09-21T01:50:04.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.433+0000 7f826d798640 1 -- start start 2024-09-21T01:50:04.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.434+0000 7f826d798640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8268074420 0x7f82681541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.434+0000 7f826d798640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 0x7f8268151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.434+0000 7f826d798640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826814c9a0 0x7f826814ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.434+0000 7f826d798640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8268166b90 con 0x7f82680b55b0 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.434+0000 7f826d798640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8268166a10 con 0x7f826814c9a0 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.434+0000 7f826d798640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f8268166d10 con 0x7f8268074420 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.434+0000 7f82667fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 0x7f8268151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f82667fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 0x7f8268151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59554/0 (socket says 172.21.15.40:59554) 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f82667fc640 1 -- 172.21.15.40:0/2650997239 learned_addr learned my addr 172.21.15.40:0/2650997239 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f8266ffd640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8268074420 0x7f82681541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f82677fe640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826814c9a0 0x7f826814ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f82667fc640 1 -- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8268074420 msgr2=0x7f82681541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f82667fc640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8268074420 0x7f82681541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f82667fc640 1 -- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826814c9a0 msgr2=0x7f826814ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f82667fc640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826814c9a0 0x7f826814ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f82667fc640 1 -- 172.21.15.40:0/2650997239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826814b900 con 0x7f82680b55b0 2024-09-21T01:50:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f82667fc640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 0x7f8268151f50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f825000b3c0 tx=0x7f825000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:04.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f825f7fe640 1 -- 172.21.15.40:0/2650997239 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250011830 con 0x7f82680b55b0 2024-09-21T01:50:04.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f825f7fe640 1 -- 172.21.15.40:0/2650997239 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8250016070 con 0x7f82680b55b0 2024-09-21T01:50:04.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826814bbe0 con 0x7f82680b55b0 2024-09-21T01:50:04.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f825f7fe640 1 -- 172.21.15.40:0/2650997239 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250011da0 con 0x7f82680b55b0 2024-09-21T01:50:04.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.435+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826814c1a0 con 0x7f82680b55b0 2024-09-21T01:50:04.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.436+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f826815c580 con 0x7f82680b55b0 2024-09-21T01:50:04.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.437+0000 7f825f7fe640 1 -- 172.21.15.40:0/2650997239 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f825001b460 con 0x7f82680b55b0 2024-09-21T01:50:04.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.438+0000 7f825f7fe640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8248078bc0 0x7f824807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.438+0000 7f825f7fe640 1 -- 172.21.15.40:0/2650997239 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f825009a6f0 con 0x7f82680b55b0 2024-09-21T01:50:04.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.438+0000 7f8266ffd640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8248078bc0 0x7f824807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.439+0000 7f8266ffd640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8248078bc0 0x7f824807b0d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82600017a0 tx=0x7f8260001730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:04.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.443+0000 7f825f7fe640 1 -- 172.21.15.40:0/2650997239 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8250020020 con 0x7f82680b55b0 2024-09-21T01:50:04.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.630+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f826815f5c0 con 0x7f82680b55b0 2024-09-21T01:50:04.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.631+0000 7f825f7fe640 1 -- 172.21.15.40:0/2650997239 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f82500624e0 con 0x7f82680b55b0 2024-09-21T01:50:04.632 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-21T01:50:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8248078bc0 msgr2=0x7f824807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8248078bc0 0x7f824807b0d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82600017a0 tx=0x7f8260001730 comp rx=0 tx=0).stop 2024-09-21T01:50:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 msgr2=0x7f8268151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 0x7f8268151f50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f825000b3c0 tx=0x7f825000b880 comp rx=0 tx=0).stop 2024-09-21T01:50:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 shutdown_connections 2024-09-21T01:50:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8248078bc0 0x7f824807b0d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f826814c9a0 0x7f826814ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82680b55b0 0x7f8268151f50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 --2- 172.21.15.40:0/2650997239 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f8268074420 0x7f82681541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 >> 172.21.15.40:0/2650997239 conn(0x7f826806def0 msgr2=0x7f82680cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:04.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 shutdown_connections 2024-09-21T01:50:04.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.633+0000 7f826d798640 1 -- 172.21.15.40:0/2650997239 wait complete. 2024-09-21T01:50:04.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T01:50:04.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.764+0000 7f69bc69b640 1 -- 172.21.15.40:0/2933731015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 msgr2=0x7f69b406fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.764+0000 7f69bc69b640 1 --2- 172.21.15.40:0/2933731015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 0x7f69b406fe30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69b40d1cd0 tx=0x7f69b002a530 comp rx=0 tx=0).stop 2024-09-21T01:50:04.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.765+0000 7f69bc69b640 1 -- 172.21.15.40:0/2933731015 shutdown_connections 2024-09-21T01:50:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.765+0000 7f69bc69b640 1 --2- 172.21.15.40:0/2933731015 >> v2:172.21.15.139:3300/0 conn(0x7f69b4155ce0 0x7f69b40b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.765+0000 7f69bc69b640 1 --2- 172.21.15.40:0/2933731015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 0x7f69b406fe30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.765+0000 7f69bc69b640 1 -- 172.21.15.40:0/2933731015 >> 172.21.15.40:0/2933731015 conn(0x7f69b406def0 msgr2=0x7f69b406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.765+0000 7f69bc69b640 1 -- 172.21.15.40:0/2933731015 shutdown_connections 2024-09-21T01:50:04.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.765+0000 7f69bc69b640 1 -- 172.21.15.40:0/2933731015 wait complete. 2024-09-21T01:50:04.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.766+0000 7f69bc69b640 1 Processor -- start 2024-09-21T01:50:04.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.766+0000 7f69bc69b640 1 -- start start 2024-09-21T01:50:04.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69bc69b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 0x7f69b413c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69bc69b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69b4155ce0 0x7f69b41f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69bc69b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f69b41f9040 0x7f69b413f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69bc69b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69b40b5030 con 0x7f69b4074420 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69bc69b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f69b40b4eb0 con 0x7f69b4155ce0 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69bc69b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f69b40b51b0 con 0x7f69b41f9040 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69ba437640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 0x7f69b413c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69ba437640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 0x7f69b413c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59582/0 (socket says 172.21.15.40:59582) 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69ba437640 1 -- 172.21.15.40:0/3769634808 learned_addr learned my addr 172.21.15.40:0/3769634808 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69b9c36640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69b4155ce0 0x7f69b41f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69bac38640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f69b41f9040 0x7f69b413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69ba437640 1 -- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f69b41f9040 msgr2=0x7f69b413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69ba437640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f69b41f9040 0x7f69b413f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69ba437640 1 -- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69b4155ce0 msgr2=0x7f69b41f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69ba437640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69b4155ce0 0x7f69b41f5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69ba437640 1 -- 172.21.15.40:0/3769634808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b414ed60 con 0x7f69b4074420 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69ba437640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 0x7f69b413c2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f69b002ab20 tx=0x7f69b0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:04.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69aaffd640 1 -- 172.21.15.40:0/3769634808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0031d60 con 0x7f69b4074420 2024-09-21T01:50:04.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69aaffd640 1 -- 172.21.15.40:0/3769634808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69b0033e10 con 0x7f69b4074420 2024-09-21T01:50:04.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b413ed10 con 0x7f69b4074420 2024-09-21T01:50:04.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.768+0000 7f69aaffd640 1 -- 172.21.15.40:0/3769634808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0005260 con 0x7f69b4074420 2024-09-21T01:50:04.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.769+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b41f59e0 con 0x7f69b4074420 2024-09-21T01:50:04.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.770+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b40b5710 con 0x7f69b4074420 2024-09-21T01:50:04.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.770+0000 7f69aaffd640 1 -- 172.21.15.40:0/3769634808 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69b0005400 con 0x7f69b4074420 2024-09-21T01:50:04.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.771+0000 7f69aaffd640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6998078b90 0x7f699807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:04.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.771+0000 7f69aaffd640 1 -- 172.21.15.40:0/3769634808 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f69b00bbeb0 con 0x7f69b4074420 2024-09-21T01:50:04.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.771+0000 7f69b9c36640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6998078b90 0x7f699807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:04.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.772+0000 7f69b9c36640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6998078b90 0x7f699807b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69a4000f60 tx=0x7f69a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.775+0000 7f69aaffd640 1 -- 172.21.15.40:0/3769634808 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f69b003f030 con 0x7f69b4074420 2024-09-21T01:50:04.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.965+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f69b415d8a0 con 0x7f69b4074420 2024-09-21T01:50:04.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.965+0000 7f69aaffd640 1 -- 172.21.15.40:0/3769634808 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f69b0005d00 con 0x7f69b4074420 2024-09-21T01:50:04.966 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6998078b90 msgr2=0x7f699807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6998078b90 0x7f699807b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69a4000f60 tx=0x7f69a4009040 comp rx=0 tx=0).stop 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 msgr2=0x7f69b413c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 0x7f69b413c2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f69b002ab20 tx=0x7f69b0033c20 comp rx=0 tx=0).stop 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 shutdown_connections 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6998078b90 0x7f699807b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f69b41f9040 0x7f69b413f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f69b4155ce0 0x7f69b41f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 --2- 172.21.15.40:0/3769634808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69b4074420 0x7f69b413c2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 >> 172.21.15.40:0/3769634808 conn(0x7f69b406def0 msgr2=0x7f69b415ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 shutdown_connections 2024-09-21T01:50:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:04.968+0000 7f69bc69b640 1 -- 172.21.15.40:0/3769634808 wait complete. 2024-09-21T01:50:04.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T01:50:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.098+0000 7f9b44638640 1 -- 172.21.15.40:0/3707362052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0cd360 msgr2=0x7f9b3c15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.098+0000 7f9b44638640 1 --2- 172.21.15.40:0/3707362052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0cd360 0x7f9b3c15c6a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0d22c0 tx=0x7f9b3802a4a0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.098+0000 7f9b44638640 1 -- 172.21.15.40:0/3707362052 shutdown_connections 2024-09-21T01:50:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.098+0000 7f9b44638640 1 --2- 172.21.15.40:0/3707362052 >> v2:172.21.15.139:3300/0 conn(0x7f9b3c0b7fe0 0x7f9b3c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.099+0000 7f9b44638640 1 --2- 172.21.15.40:0/3707362052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0cd360 0x7f9b3c15c6a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.099+0000 7f9b44638640 1 -- 172.21.15.40:0/3707362052 >> 172.21.15.40:0/3707362052 conn(0x7f9b3c0710b0 msgr2=0x7f9b3c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.099+0000 7f9b44638640 1 -- 172.21.15.40:0/3707362052 shutdown_connections 2024-09-21T01:50:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.099+0000 7f9b44638640 1 -- 172.21.15.40:0/3707362052 wait complete. 2024-09-21T01:50:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.100+0000 7f9b44638640 1 Processor -- start 2024-09-21T01:50:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.100+0000 7f9b44638640 1 -- start start 2024-09-21T01:50:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b44638640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0b7fe0 0x7f9b3c0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b44638640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b3c0cd360 0x7f9b3c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b44638640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3c0cf270 0x7f9b3c06ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b44638640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c072f60 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b44638640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c0d13b0 con 0x7f9b3c0cf270 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b44638640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c0730e0 con 0x7f9b3c0cd360 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b423d4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0b7fe0 0x7f9b3c0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b423d4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0b7fe0 0x7f9b3c0b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59606/0 (socket says 172.21.15.40:59606) 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b423d4640 1 -- 172.21.15.40:0/3662349495 learned_addr learned my addr 172.21.15.40:0/3662349495 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b42bd5640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3c0cf270 0x7f9b3c06ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b41bd3640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b3c0cd360 0x7f9b3c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b423d4640 1 -- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b3c0cd360 msgr2=0x7f9b3c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b423d4640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b3c0cd360 0x7f9b3c15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b423d4640 1 -- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3c0cf270 msgr2=0x7f9b3c06ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b423d4640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3c0cf270 0x7f9b3c06ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b423d4640 1 -- 172.21.15.40:0/3662349495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c0b1700 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.102+0000 7f9b423d4640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0b7fe0 0x7f9b3c0b11c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9b380098f0 tx=0x7f9b38033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.103+0000 7f9b32ffd640 1 -- 172.21.15.40:0/3662349495 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38005c90 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.103+0000 7f9b32ffd640 1 -- 172.21.15.40:0/3662349495 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b38031e50 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.103+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c0cb250 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.103+0000 7f9b32ffd640 1 -- 172.21.15.40:0/3662349495 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38005260 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.103+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c0cb7d0 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.104+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c0b73a0 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.104+0000 7f9b32ffd640 1 -- 172.21.15.40:0/3662349495 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b38005400 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.105+0000 7f9b32ffd640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b20078bc0 0x7f9b2007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:05.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.105+0000 7f9b32ffd640 1 -- 172.21.15.40:0/3662349495 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9b380bbd20 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.105+0000 7f9b41bd3640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b20078bc0 0x7f9b2007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:05.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.106+0000 7f9b41bd3640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b20078bc0 0x7f9b2007b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0b2410 tx=0x7f9b2c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:05.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.109+0000 7f9b32ffd640 1 -- 172.21.15.40:0/3662349495 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9b3c0b73a0 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.300+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9b3c0b5350 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.300+0000 7f9b32ffd640 1 -- 172.21.15.40:0/3662349495 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f9b3c0b5350 con 0x7f9b3c0b7fe0 2024-09-21T01:50:05.301 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-09-21T01:50:05.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b20078bc0 msgr2=0x7f9b2007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:05.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b20078bc0 0x7f9b2007b0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0b2410 tx=0x7f9b2c00b2e0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0b7fe0 msgr2=0x7f9b3c0b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0b7fe0 0x7f9b3c0b11c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9b380098f0 tx=0x7f9b38033c20 comp rx=0 tx=0).stop 2024-09-21T01:50:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 shutdown_connections 2024-09-21T01:50:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b20078bc0 0x7f9b2007b0d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b3c0cf270 0x7f9b3c06ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9b3c0cd360 0x7f9b3c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 --2- 172.21.15.40:0/3662349495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b3c0b7fe0 0x7f9b3c0b11c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 >> 172.21.15.40:0/3662349495 conn(0x7f9b3c0710b0 msgr2=0x7f9b3c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.302+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 shutdown_connections 2024-09-21T01:50:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.303+0000 7f9b44638640 1 -- 172.21.15.40:0/3662349495 wait complete. 2024-09-21T01:50:05.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-09-21T01:50:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.434+0000 7f079a041640 1 -- 172.21.15.40:0/3771992327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c004d40 msgr2=0x7f077c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.434+0000 7f079a041640 1 --2- 172.21.15.40:0/3771992327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c004d40 0x7f077c005150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f079408e3a0 tx=0x7f077c005830 comp rx=0 tx=0).stop 2024-09-21T01:50:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.434+0000 7f0793fff640 1 -- 172.21.15.40:0/3771992327 reap_dead start 2024-09-21T01:50:05.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.435+0000 7f079a041640 1 -- 172.21.15.40:0/3771992327 shutdown_connections 2024-09-21T01:50:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.435+0000 7f079a041640 1 -- 172.21.15.40:0/3771992327 >> 172.21.15.40:0/3771992327 conn(0x7f079408bfc0 msgr2=0x7f079409d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.435+0000 7f079a041640 1 -- 172.21.15.40:0/3771992327 shutdown_connections 2024-09-21T01:50:05.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.435+0000 7f079a041640 1 -- 172.21.15.40:0/3771992327 wait complete. 2024-09-21T01:50:05.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.436+0000 7f079a041640 1 Processor -- start 2024-09-21T01:50:05.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.437+0000 7f079a041640 1 -- start start 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f079a041640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c004d40 0x7f07941545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f079a041640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07940cb440 0x7f07940cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f079a041640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07940b5c70 0x7f07940b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f079a041640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f07940b9be0 con 0x7f077c004d40 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f079a041640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f07940d4e20 con 0x7f07940b5c70 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f079a041640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f07940b9d60 con 0x7f07940cb440 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f07937fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c004d40 0x7f07941545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f07937fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c004d40 0x7f07941545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59628/0 (socket says 172.21.15.40:59628) 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f07937fe640 1 -- 172.21.15.40:0/629668341 learned_addr learned my addr 172.21.15.40:0/629668341 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f0792ffd640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07940cb440 0x7f07940cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:05.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f0793fff640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07940b5c70 0x7f07940b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f07937fe640 1 -- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07940cb440 msgr2=0x7f07940cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f07937fe640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07940cb440 0x7f07940cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f07937fe640 1 -- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07940b5c70 msgr2=0x7f07940b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f07937fe640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07940b5c70 0x7f07940b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f07937fe640 1 -- 172.21.15.40:0/629668341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07940b65c0 con 0x7f077c004d40 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f0792ffd640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07940cb440 0x7f07940cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f0793fff640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07940b5c70 0x7f07940b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.438+0000 7f07937fe640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c004d40 0x7f07941545e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0784011ab0 tx=0x7f0784011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.439+0000 7f077bfff640 1 -- 172.21.15.40:0/629668341 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078401e070 con 0x7f077c004d40 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.439+0000 7f077bfff640 1 -- 172.21.15.40:0/629668341 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f078400fe70 con 0x7f077c004d40 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.439+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0794151f40 con 0x7f077c004d40 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.439+0000 7f077bfff640 1 -- 172.21.15.40:0/629668341 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07840042b0 con 0x7f077c004d40 2024-09-21T01:50:05.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.439+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0794152500 con 0x7f077c004d40 2024-09-21T01:50:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.440+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07940d4510 con 0x7f077c004d40 2024-09-21T01:50:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.441+0000 7f077bfff640 1 -- 172.21.15.40:0/629668341 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0784021070 con 0x7f077c004d40 2024-09-21T01:50:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.441+0000 7f077bfff640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0780078bc0 0x7f078007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.441+0000 7f077bfff640 1 -- 172.21.15.40:0/629668341 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f078409b650 con 0x7f077c004d40 2024-09-21T01:50:05.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.441+0000 7f0792ffd640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0780078bc0 0x7f078007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:05.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.442+0000 7f0792ffd640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0780078bc0 0x7f078007b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0794076340 tx=0x7f0788005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:05.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.446+0000 7f077bfff640 1 -- 172.21.15.40:0/629668341 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f07940b65c0 con 0x7f077c004d40 2024-09-21T01:50:05.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:05.707+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f07940b59d0 con 0x7f077c004d40 2024-09-21T01:50:06.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:50:06.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:50:06.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.409+0000 7f077bfff640 1 -- 172.21.15.40:0/629668341 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v45) ==== 147+0+0 (secure 0 0 0) 0x7f07840634d0 con 0x7f077c004d40 2024-09-21T01:50:06.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0780078bc0 msgr2=0x7f078007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0780078bc0 0x7f078007b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0794076340 tx=0x7f0788005f90 comp rx=0 tx=0).stop 2024-09-21T01:50:06.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c004d40 msgr2=0x7f07941545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c004d40 0x7f07941545e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0784011ab0 tx=0x7f0784011f70 comp rx=0 tx=0).stop 2024-09-21T01:50:06.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 shutdown_connections 2024-09-21T01:50:06.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0780078bc0 0x7f078007b0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f07940b5c70 0x7f07940b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f07940cb440 0x7f07940cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 --2- 172.21.15.40:0/629668341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f077c004d40 0x7f07941545e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.412+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 >> 172.21.15.40:0/629668341 conn(0x7f079408bfc0 msgr2=0x7f0794161ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:06.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.413+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 shutdown_connections 2024-09-21T01:50:06.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.413+0000 7f079a041640 1 -- 172.21.15.40:0/629668341 wait complete. 2024-09-21T01:50:06.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T01:50:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.549+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3173077993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0cf7a0 msgr2=0x7fdfbc1626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.549+0000 7fdfc13e4640 1 --2- 172.21.15.40:0/3173077993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0cf7a0 0x7fdfbc1626e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc08d4e0 tx=0x7fdfb402aa30 comp rx=0 tx=0).stop 2024-09-21T01:50:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.549+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3173077993 shutdown_connections 2024-09-21T01:50:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.549+0000 7fdfc13e4640 1 --2- 172.21.15.40:0/3173077993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0cf7a0 0x7fdfbc1626e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.549+0000 7fdfc13e4640 1 --2- 172.21.15.40:0/3173077993 >> v2:172.21.15.139:3300/0 conn(0x7fdfbc0d2ed0 0x7fdfbc0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.549+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3173077993 >> 172.21.15.40:0/3173077993 conn(0x7fdfbc08bfc0 msgr2=0x7fdfbc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.549+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3173077993 shutdown_connections 2024-09-21T01:50:06.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.549+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3173077993 wait complete. 2024-09-21T01:50:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.551+0000 7fdfc13e4640 1 Processor -- start 2024-09-21T01:50:06.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.551+0000 7fdfc13e4640 1 -- start start 2024-09-21T01:50:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfc13e4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfbc0b9b70 0x7fdfbc0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfc13e4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfbc0cf7a0 0x7fdfbc0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfc13e4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0d2ed0 0x7fdfbc0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfc13e4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc162c20 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfc13e4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc0cfed0 con 0x7fdfbc0cf7a0 2024-09-21T01:50:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfc13e4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc162da0 con 0x7fdfbc0b9b70 2024-09-21T01:50:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0d2ed0 0x7fdfbc0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfbb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0d2ed0 0x7fdfbc0ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59648/0 (socket says 172.21.15.40:59648) 2024-09-21T01:50:06.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfbb7fe640 1 -- 172.21.15.40:0/3687449443 learned_addr learned my addr 172.21.15.40:0/3687449443 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfbaffd640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfbc0b9b70 0x7fdfbc0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.552+0000 7fdfba7fc640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfbc0cf7a0 0x7fdfbc0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfbb7fe640 1 -- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfbc0b9b70 msgr2=0x7fdfbc0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfbb7fe640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfbc0b9b70 0x7fdfbc0cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfbb7fe640 1 -- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfbc0cf7a0 msgr2=0x7fdfbc0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfbb7fe640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfbc0cf7a0 0x7fdfbc0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfbb7fe640 1 -- 172.21.15.40:0/3687449443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc0cdc40 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfba7fc640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfbc0cf7a0 0x7fdfbc0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfbb7fe640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0d2ed0 0x7fdfbc0ca7d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009d60 tx=0x7fdfb4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfa37fe640 1 -- 172.21.15.40:0/3687449443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4033050 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfa37fe640 1 -- 172.21.15.40:0/3687449443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfb4004550 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc0cded0 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfa37fe640 1 -- 172.21.15.40:0/3687449443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4038450 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.553+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc0c8bf0 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.554+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfbc1633b0 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.555+0000 7fdfa37fe640 1 -- 172.21.15.40:0/3687449443 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdfb4036070 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.555+0000 7fdfa37fe640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdfa8078b90 0x7fdfa807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.556+0000 7fdfa37fe640 1 -- 172.21.15.40:0/3687449443 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdfb40bc2e0 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.556+0000 7fdfbaffd640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdfa8078b90 0x7fdfa807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:06.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.557+0000 7fdfbaffd640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdfa8078b90 0x7fdfa807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009960 tx=0x7fdfac009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:06.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.560+0000 7fdfa37fe640 1 -- 172.21.15.40:0/3687449443 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdfb4084720 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.752+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fdfbc051040 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.753+0000 7fdfa37fe640 1 -- 172.21.15.40:0/3687449443 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7fdfb4084020 con 0x7fdfbc0d2ed0 2024-09-21T01:50:06.753 INFO:teuthology.orchestra.run.smithi040.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:mgr advanced client_mount_timeout 30 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:mgr advanced debug_client 20/20 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:mgr advanced debug_mgr 20/20 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:mgr advanced debug_ms 1/1 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4794.163516 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4074.295872 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4484.657652 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5306.615857 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4676.245636 2024-09-21T01:50:06.754 INFO:teuthology.orchestra.run.smithi040.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4909.396209 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4576.069916 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4930.312247 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced debug_mds 20/20 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced debug_ms 2/2 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds dev mds_debug_frag true 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds dev mds_debug_scatterstat true 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds dev mds_verify_scatter true 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced client_mount_timeout 600 2024-09-21T01:50:06.755 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced debug_client 20/20 2024-09-21T01:50:06.756 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced debug_ms 1/1 2024-09-21T01:50:06.756 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T01:50:06.756 INFO:teuthology.orchestra.run.smithi040.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.755+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdfa8078b90 msgr2=0x7fdfa807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.755+0000 7fdfc13e4640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdfa8078b90 0x7fdfa807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009960 tx=0x7fdfac009060 comp rx=0 tx=0).stop 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.755+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0d2ed0 msgr2=0x7fdfbc0ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.755+0000 7fdfc13e4640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0d2ed0 0x7fdfbc0ca7d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009d60 tx=0x7fdfb4003f10 comp rx=0 tx=0).stop 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.755+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 shutdown_connections 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.755+0000 7fdfc13e4640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdfa8078b90 0x7fdfa807b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.755+0000 7fdfc13e4640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfbc0d2ed0 0x7fdfbc0ca7d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.756+0000 7fdfc13e4640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdfbc0cf7a0 0x7fdfbc0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.756+0000 7fdfc13e4640 1 --2- 172.21.15.40:0/3687449443 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdfbc0b9b70 0x7fdfbc0cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.756+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 >> 172.21.15.40:0/3687449443 conn(0x7fdfbc08bfc0 msgr2=0x7fdfbc0ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.756+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 shutdown_connections 2024-09-21T01:50:06.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.756+0000 7fdfc13e4640 1 -- 172.21.15.40:0/3687449443 wait complete. 2024-09-21T01:50:06.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T01:50:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.888+0000 7f772848b640 1 -- 172.21.15.40:0/1809156873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77200d4c30 msgr2=0x7f77200b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.888+0000 7f772848b640 1 --2- 172.21.15.40:0/1809156873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77200d4c30 0x7f77200b9900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7718009850 tx=0x7f771802a530 comp rx=0 tx=0).stop 2024-09-21T01:50:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.889+0000 7f772848b640 1 -- 172.21.15.40:0/1809156873 shutdown_connections 2024-09-21T01:50:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.889+0000 7f772848b640 1 --2- 172.21.15.40:0/1809156873 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77200b3910 0x7f77200b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.889+0000 7f772848b640 1 --2- 172.21.15.40:0/1809156873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77200d4c30 0x7f77200b9900 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.889+0000 7f772848b640 1 -- 172.21.15.40:0/1809156873 >> 172.21.15.40:0/1809156873 conn(0x7f772009d830 msgr2=0x7f77200d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.889+0000 7f772848b640 1 -- 172.21.15.40:0/1809156873 shutdown_connections 2024-09-21T01:50:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.889+0000 7f772848b640 1 -- 172.21.15.40:0/1809156873 wait complete. 2024-09-21T01:50:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.890+0000 7f772848b640 1 Processor -- start 2024-09-21T01:50:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.890+0000 7f772848b640 1 -- start start 2024-09-21T01:50:06.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f772848b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77200b3910 0x7f772015c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f772848b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77200b64e0 0x7f772014d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f772848b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77200d4c30 0x7f77200cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f772848b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f77200cf610 con 0x7f77200b64e0 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f772848b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f77200cf490 con 0x7f77200b3910 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f772848b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f77200cf790 con 0x7f77200d4c30 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7725a26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77200b64e0 0x7f772014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7725a26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77200b64e0 0x7f772014d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59658/0 (socket says 172.21.15.40:59658) 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7725a26640 1 -- 172.21.15.40:0/886930229 learned_addr learned my addr 172.21.15.40:0/886930229 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7726227640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77200b3910 0x7f772015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7726a28640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77200d4c30 0x7f77200cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7725a26640 1 -- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77200d4c30 msgr2=0x7f77200cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7725a26640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77200d4c30 0x7f77200cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7725a26640 1 -- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77200b3910 msgr2=0x7f772015c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7725a26640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77200b3910 0x7f772015c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7725a26640 1 -- 172.21.15.40:0/886930229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772015afb0 con 0x7f77200b64e0 2024-09-21T01:50:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.892+0000 7f7725a26640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77200b64e0 0x7f772014d500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f771400e790 tx=0x7f771400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.893+0000 7f771effd640 1 -- 172.21.15.40:0/886930229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771400cac0 con 0x7f77200b64e0 2024-09-21T01:50:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.893+0000 7f771effd640 1 -- 172.21.15.40:0/886930229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f771400cc60 con 0x7f77200b64e0 2024-09-21T01:50:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.893+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772015b290 con 0x7f77200b64e0 2024-09-21T01:50:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.893+0000 7f771effd640 1 -- 172.21.15.40:0/886930229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714005280 con 0x7f77200b64e0 2024-09-21T01:50:06.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.893+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772015b850 con 0x7f77200b64e0 2024-09-21T01:50:06.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.894+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772015ad20 con 0x7f77200b64e0 2024-09-21T01:50:06.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.895+0000 7f771effd640 1 -- 172.21.15.40:0/886930229 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7714005420 con 0x7f77200b64e0 2024-09-21T01:50:06.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.895+0000 7f771effd640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f770c078b90 0x7f770c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:06.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.895+0000 7f771effd640 1 -- 172.21.15.40:0/886930229 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f771409b6d0 con 0x7f77200b64e0 2024-09-21T01:50:06.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.895+0000 7f7726227640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f770c078b90 0x7f770c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:06.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.896+0000 7f7726227640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f770c078b90 0x7f770c07b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7718034000 tx=0x7f7718004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:06.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:06.900+0000 7f771effd640 1 -- 172.21.15.40:0/886930229 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7714063a90 con 0x7f77200b64e0 2024-09-21T01:50:07.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.086+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f77200b5fa0 con 0x7f77200b64e0 2024-09-21T01:50:07.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.089+0000 7f771effd640 1 -- 172.21.15.40:0/886930229 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f7714063390 con 0x7f77200b64e0 2024-09-21T01:50:07.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f770c078b90 msgr2=0x7f770c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f770c078b90 0x7f770c07b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7718034000 tx=0x7f7718004730 comp rx=0 tx=0).stop 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77200b64e0 msgr2=0x7f772014d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77200b64e0 0x7f772014d500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f771400e790 tx=0x7f771400ec50 comp rx=0 tx=0).stop 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 shutdown_connections 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f770c078b90 0x7f770c07b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f77200d4c30 0x7f77200cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77200b64e0 0x7f772014d500 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 --2- 172.21.15.40:0/886930229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f77200b3910 0x7f772015c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 >> 172.21.15.40:0/886930229 conn(0x7f772009d830 msgr2=0x7f77200b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 shutdown_connections 2024-09-21T01:50:07.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.092+0000 7f772848b640 1 -- 172.21.15.40:0/886930229 wait complete. 2024-09-21T01:50:07.103 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T01:50:07.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T01:50:07.145 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T01:50:07.187 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T01:50:07.188 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:50:07.188 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:07.204 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:50:07.204 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:07.260 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:50:07.260 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:07.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T01:50:07.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.478+0000 7f75fb339640 1 -- 172.21.15.40:0/4091106457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 msgr2=0x7f75dc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:07.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.478+0000 7f75fb339640 1 --2- 172.21.15.40:0/4091106457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 0x7f75dc00b9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00c310 tx=0x7f75dc005830 comp rx=0 tx=0).stop 2024-09-21T01:50:07.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.478+0000 7f75fb339640 1 -- 172.21.15.40:0/4091106457 shutdown_connections 2024-09-21T01:50:07.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.478+0000 7f75fb339640 1 --2- 172.21.15.40:0/4091106457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 0x7f75dc00b9c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.478+0000 7f75fb339640 1 -- 172.21.15.40:0/4091106457 >> 172.21.15.40:0/4091106457 conn(0x7f75f4072ae0 msgr2=0x7f75f4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:07.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.478+0000 7f75fb339640 1 -- 172.21.15.40:0/4091106457 shutdown_connections 2024-09-21T01:50:07.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.478+0000 7f75fb339640 1 -- 172.21.15.40:0/4091106457 wait complete. 2024-09-21T01:50:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.480+0000 7f75fb339640 1 Processor -- start 2024-09-21T01:50:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.480+0000 7f75fb339640 1 -- start start 2024-09-21T01:50:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.481+0000 7f75fb339640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 0x7f75f4158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.481+0000 7f75fb339640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75f4158db0 0x7f75f4148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.481+0000 7f75fb339640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75f41492e0 0x7f75f41496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.481+0000 7f75fb339640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75f415c860 con 0x7f75dc005250 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.481+0000 7f75fb339640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f75f415c6e0 con 0x7f75f41492e0 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.481+0000 7f75fb339640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f75f415c9e0 con 0x7f75f4158db0 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.481+0000 7f75f90d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 0x7f75f4158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.481+0000 7f75f90d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 0x7f75f4158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59678/0 (socket says 172.21.15.40:59678) 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.481+0000 7f75f90d5640 1 -- 172.21.15.40:0/2714435024 learned_addr learned my addr 172.21.15.40:0/2714435024 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f88d4640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75f4158db0 0x7f75f4148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f98d6640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75f41492e0 0x7f75f41496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f90d5640 1 -- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75f4158db0 msgr2=0x7f75f4148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f90d5640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75f4158db0 0x7f75f4148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f90d5640 1 -- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75f41492e0 msgr2=0x7f75f41496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f90d5640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75f41492e0 0x7f75f41496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f90d5640 1 -- 172.21.15.40:0/2714435024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f4149c30 con 0x7f75dc005250 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f90d5640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 0x7f75f4158870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f75e4011c40 tx=0x7f75e400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f1ffb640 1 -- 172.21.15.40:0/2714435024 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4003e40 con 0x7f75dc005250 2024-09-21T01:50:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f1ffb640 1 -- 172.21.15.40:0/2714435024 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75e4004b20 con 0x7f75dc005250 2024-09-21T01:50:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f41488c0 con 0x7f75dc005250 2024-09-21T01:50:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75f1ffb640 1 -- 172.21.15.40:0/2714435024 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4004050 con 0x7f75dc005250 2024-09-21T01:50:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.482+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f41596c0 con 0x7f75dc005250 2024-09-21T01:50:07.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.484+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f415cbc0 con 0x7f75dc005250 2024-09-21T01:50:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.484+0000 7f75f1ffb640 1 -- 172.21.15.40:0/2714435024 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75e40041f0 con 0x7f75dc005250 2024-09-21T01:50:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.485+0000 7f75f1ffb640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f75e0078b90 0x7f75e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.485+0000 7f75f1ffb640 1 -- 172.21.15.40:0/2714435024 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f75e409c060 con 0x7f75dc005250 2024-09-21T01:50:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.485+0000 7f75f88d4640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f75e0078b90 0x7f75e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.486+0000 7f75f88d4640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f75e0078b90 0x7f75e007b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75f41f6a20 tx=0x7f75e8006b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:07.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.489+0000 7f75f1ffb640 1 -- 172.21.15.40:0/2714435024 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f75e4063db0 con 0x7f75dc005250 2024-09-21T01:50:07.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.693+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f75f40cc9b0 con 0x7f75dc005250 2024-09-21T01:50:07.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.693+0000 7f75f1ffb640 1 -- 172.21.15.40:0/2714435024 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f75e40687e0 con 0x7f75dc005250 2024-09-21T01:50:07.694 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-21T01:50:07.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f75e0078b90 msgr2=0x7f75e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:07.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f75e0078b90 0x7f75e007b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75f41f6a20 tx=0x7f75e8006b70 comp rx=0 tx=0).stop 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 msgr2=0x7f75f4158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 0x7f75f4158870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f75e4011c40 tx=0x7f75e400f790 comp rx=0 tx=0).stop 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 shutdown_connections 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f75e0078b90 0x7f75e007b0a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75f41492e0 0x7f75f41496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75f4158db0 0x7f75f4148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 --2- 172.21.15.40:0/2714435024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75dc005250 0x7f75f4158870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 >> 172.21.15.40:0/2714435024 conn(0x7f75f4072ae0 msgr2=0x7f75f40b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 shutdown_connections 2024-09-21T01:50:07.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:07.696+0000 7f75fb339640 1 -- 172.21.15.40:0/2714435024 wait complete. 2024-09-21T01:50:07.708 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T01:50:07.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:07.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-21T01:50:07.735 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-09-21T01:50:07.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:07.735 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T01:50:07.800 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:50:07.800 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:07.820 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:50:07.820 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:07.879 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:50:07.879 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:07.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T01:50:08.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.054+0000 7f7584a94640 1 -- 172.21.15.40:0/4163116425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800b51c0 msgr2=0x7f758015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.054+0000 7f7584a94640 1 --2- 172.21.15.40:0/4163116425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800b51c0 0x7f758015c6e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7580073b60 tx=0x7f757802a8b0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.054+0000 7f7584a94640 1 -- 172.21.15.40:0/4163116425 shutdown_connections 2024-09-21T01:50:08.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.054+0000 7f7584a94640 1 --2- 172.21.15.40:0/4163116425 >> v2:172.21.15.139:3300/0 conn(0x7f75800ccbd0 0x7f75800d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.054+0000 7f7584a94640 1 --2- 172.21.15.40:0/4163116425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800b51c0 0x7f758015c6e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.054+0000 7f7584a94640 1 -- 172.21.15.40:0/4163116425 >> 172.21.15.40:0/4163116425 conn(0x7f7580072ae0 msgr2=0x7f7580072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:08.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.054+0000 7f7584a94640 1 -- 172.21.15.40:0/4163116425 shutdown_connections 2024-09-21T01:50:08.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.054+0000 7f7584a94640 1 -- 172.21.15.40:0/4163116425 wait complete. 2024-09-21T01:50:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.056+0000 7f7584a94640 1 Processor -- start 2024-09-21T01:50:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.056+0000 7f7584a94640 1 -- start start 2024-09-21T01:50:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f7584a94640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75800b51c0 0x7f75801f9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f7584a94640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75800ccbd0 0x7f75801f9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f7584a94640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800d12c0 0x7f7580157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f7584a94640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75800d19f0 con 0x7f75800d12c0 2024-09-21T01:50:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f7584a94640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7580160a60 con 0x7f75800ccbd0 2024-09-21T01:50:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f7584a94640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f758006f6b0 con 0x7f75800b51c0 2024-09-21T01:50:08.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800d12c0 0x7f7580157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800d12c0 0x7f7580157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59696/0 (socket says 172.21.15.40:59696) 2024-09-21T01:50:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757ed9d640 1 -- 172.21.15.40:0/2868826283 learned_addr learned my addr 172.21.15.40:0/2868826283 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757e59c640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75800b51c0 0x7f75801f9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757dd9b640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75800ccbd0 0x7f75801f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757ed9d640 1 -- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75800b51c0 msgr2=0x7f75801f9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757ed9d640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75800b51c0 0x7f75801f9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757ed9d640 1 -- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75800ccbd0 msgr2=0x7f75801f9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757ed9d640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75800ccbd0 0x7f75801f9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757ed9d640 1 -- 172.21.15.40:0/2868826283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75801f9fc0 con 0x7f75800d12c0 2024-09-21T01:50:08.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.058+0000 7f757ed9d640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800d12c0 0x7f7580157cf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f757000c3c0 tx=0x7f757000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:08.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.059+0000 7f7576ffd640 1 -- 172.21.15.40:0/2868826283 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570017070 con 0x7f75800d12c0 2024-09-21T01:50:08.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.059+0000 7f7576ffd640 1 -- 172.21.15.40:0/2868826283 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75700035f0 con 0x7f75800d12c0 2024-09-21T01:50:08.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.059+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7580157570 con 0x7f75800d12c0 2024-09-21T01:50:08.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.059+0000 7f7576ffd640 1 -- 172.21.15.40:0/2868826283 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570003a40 con 0x7f75800d12c0 2024-09-21T01:50:08.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.059+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75801f9cc0 con 0x7f75800d12c0 2024-09-21T01:50:08.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.060+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7580075330 con 0x7f75800d12c0 2024-09-21T01:50:08.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.060+0000 7f7576ffd640 1 -- 172.21.15.40:0/2868826283 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f757001a070 con 0x7f75800d12c0 2024-09-21T01:50:08.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.061+0000 7f7576ffd640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7560078b90 0x7f756007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:08.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.061+0000 7f7576ffd640 1 -- 172.21.15.40:0/2868826283 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7570099eb0 con 0x7f75800d12c0 2024-09-21T01:50:08.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.061+0000 7f757e59c640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7560078b90 0x7f756007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:08.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.062+0000 7f757e59c640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7560078b90 0x7f756007b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7578034000 tx=0x7f7578004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:08.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.065+0000 7f7576ffd640 1 -- 172.21.15.40:0/2868826283 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7580075330 con 0x7f75800d12c0 2024-09-21T01:50:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.267+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f758015c6e0 con 0x7f75800d12c0 2024-09-21T01:50:08.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.267+0000 7f7576ffd640 1 -- 172.21.15.40:0/2868826283 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f758015c6e0 con 0x7f75800d12c0 2024-09-21T01:50:08.268 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-21T01:50:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7560078b90 msgr2=0x7f756007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7560078b90 0x7f756007b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7578034000 tx=0x7f7578004ab0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800d12c0 msgr2=0x7f7580157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800d12c0 0x7f7580157cf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f757000c3c0 tx=0x7f757000c880 comp rx=0 tx=0).stop 2024-09-21T01:50:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 shutdown_connections 2024-09-21T01:50:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7560078b90 0x7f756007b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75800d12c0 0x7f7580157cf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f75800ccbd0 0x7f75801f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 --2- 172.21.15.40:0/2868826283 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f75800b51c0 0x7f75801f9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 >> 172.21.15.40:0/2868826283 conn(0x7f7580072ae0 msgr2=0x7f7580068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 shutdown_connections 2024-09-21T01:50:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.269+0000 7f7584a94640 1 -- 172.21.15.40:0/2868826283 wait complete. 2024-09-21T01:50:08.281 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T01:50:08.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:08.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-21T01:50:08.313 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2024-09-21T01:50:08.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:08.313 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T01:50:08.380 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:50:08.380 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:08.397 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:50:08.397 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:08.454 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:50:08.454 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:08.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T01:50:08.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.667+0000 7f9df2924640 1 -- 172.21.15.40:0/1917843146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9dec0b3a10 msgr2=0x7f9dec0d14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.667+0000 7f9df2924640 1 --2- 172.21.15.40:0/1917843146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9dec0b3a10 0x7f9dec0d14f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9de0005fd0 tx=0x7f9de002a540 comp rx=0 tx=0).stop 2024-09-21T01:50:08.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.667+0000 7f9df2924640 1 -- 172.21.15.40:0/1917843146 shutdown_connections 2024-09-21T01:50:08.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.667+0000 7f9df2924640 1 --2- 172.21.15.40:0/1917843146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9dec0b3a10 0x7f9dec0d14f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.667+0000 7f9df2924640 1 --2- 172.21.15.40:0/1917843146 >> v2:172.21.15.139:3300/0 conn(0x7f9dec0b9b60 0x7f9dec0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.667+0000 7f9df2924640 1 -- 172.21.15.40:0/1917843146 >> 172.21.15.40:0/1917843146 conn(0x7f9dec09d8f0 msgr2=0x7f9dec0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.667+0000 7f9df2924640 1 -- 172.21.15.40:0/1917843146 shutdown_connections 2024-09-21T01:50:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.667+0000 7f9df2924640 1 -- 172.21.15.40:0/1917843146 wait complete. 2024-09-21T01:50:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.669+0000 7f9df2924640 1 Processor -- start 2024-09-21T01:50:08.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.669+0000 7f9df2924640 1 -- start start 2024-09-21T01:50:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9df2924640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9dec0b3a10 0x7f9dec0b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9df2924640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dec0b9b60 0x7f9dec0b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9df2924640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dec162430 0x7f9dec0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9df2924640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9dec162f50 con 0x7f9dec0b9b60 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9df2924640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9dec0d1fa0 con 0x7f9dec162430 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9df2924640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f9dec1630d0 con 0x7f9dec0b3a10 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9deb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dec0b9b60 0x7f9dec0b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9deb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dec0b9b60 0x7f9dec0b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59706/0 (socket says 172.21.15.40:59706) 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9deb7fe640 1 -- 172.21.15.40:0/1487722902 learned_addr learned my addr 172.21.15.40:0/1487722902 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9debfff640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9dec0b3a10 0x7f9dec0b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9df0ec1640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dec162430 0x7f9dec0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9deb7fe640 1 -- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9dec0b3a10 msgr2=0x7f9dec0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9deb7fe640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9dec0b3a10 0x7f9dec0b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9deb7fe640 1 -- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dec162430 msgr2=0x7f9dec0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9deb7fe640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dec162430 0x7f9dec0b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9deb7fe640 1 -- 172.21.15.40:0/1487722902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dec0b43d0 con 0x7f9dec0b9b60 2024-09-21T01:50:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9deb7fe640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dec0b9b60 0x7f9dec0b26a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9de0034040 tx=0x7f9de00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:08.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.671+0000 7f9de8ff9640 1 -- 172.21.15.40:0/1487722902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de003e030 con 0x7f9dec0b9b60 2024-09-21T01:50:08.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.672+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dec0b46b0 con 0x7f9dec0b9b60 2024-09-21T01:50:08.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.672+0000 7f9de8ff9640 1 -- 172.21.15.40:0/1487722902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9de0003db0 con 0x7f9dec0b9b60 2024-09-21T01:50:08.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.672+0000 7f9de8ff9640 1 -- 172.21.15.40:0/1487722902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de0035040 con 0x7f9dec0b9b60 2024-09-21T01:50:08.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.672+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dec159100 con 0x7f9dec0b9b60 2024-09-21T01:50:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.673+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dec162840 con 0x7f9dec0b9b60 2024-09-21T01:50:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.673+0000 7f9de8ff9640 1 -- 172.21.15.40:0/1487722902 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9de0041030 con 0x7f9dec0b9b60 2024-09-21T01:50:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.674+0000 7f9de8ff9640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9dd8078b90 0x7f9dd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.674+0000 7f9de8ff9640 1 -- 172.21.15.40:0/1487722902 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9de00bb360 con 0x7f9dec0b9b60 2024-09-21T01:50:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.674+0000 7f9debfff640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9dd8078b90 0x7f9dd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.675+0000 7f9debfff640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9dd8078b90 0x7f9dd807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0095f0 tx=0x7f9ddc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:08.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.678+0000 7f9de8ff9640 1 -- 172.21.15.40:0/1487722902 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9de0083160 con 0x7f9dec0b9b60 2024-09-21T01:50:08.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.879+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9dec0b3120 con 0x7f9dec0b9b60 2024-09-21T01:50:08.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.880+0000 7f9de8ff9640 1 -- 172.21.15.40:0/1487722902 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f9de0087b90 con 0x7f9dec0b9b60 2024-09-21T01:50:08.881 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-21T01:50:08.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9dd8078b90 msgr2=0x7f9dd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9dd8078b90 0x7f9dd807b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0095f0 tx=0x7f9ddc005f90 comp rx=0 tx=0).stop 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dec0b9b60 msgr2=0x7f9dec0b26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dec0b9b60 0x7f9dec0b26a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9de0034040 tx=0x7f9de00038a0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 shutdown_connections 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9dd8078b90 0x7f9dd807b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dec162430 0x7f9dec0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dec0b9b60 0x7f9dec0b26a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 --2- 172.21.15.40:0/1487722902 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9dec0b3a10 0x7f9dec0b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.882+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 >> 172.21.15.40:0/1487722902 conn(0x7f9dec09d8f0 msgr2=0x7f9dec15a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.883+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 shutdown_connections 2024-09-21T01:50:08.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:08.883+0000 7f9df2924640 1 -- 172.21.15.40:0/1487722902 wait complete. 2024-09-21T01:50:08.894 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-21T01:50:08.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:08.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-21T01:50:08.921 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-09-21T01:50:08.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:08.922 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-21T01:50:08.977 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:50:08.978 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:08.998 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:50:08.998 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:09.056 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-21T01:50:09.056 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:09.114 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T01:50:09.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.232+0000 7fc17d3e6640 1 -- 172.21.15.40:0/3927495262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b3a10 msgr2=0x7fc1780cf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.232+0000 7fc17d3e6640 1 --2- 172.21.15.40:0/3927495262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b3a10 0x7fc1780cf850 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc1780d43c0 tx=0x7fc16802a980 comp rx=0 tx=0).stop 2024-09-21T01:50:09.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.232+0000 7fc17d3e6640 1 -- 172.21.15.40:0/3927495262 shutdown_connections 2024-09-21T01:50:09.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.232+0000 7fc17d3e6640 1 --2- 172.21.15.40:0/3927495262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b3a10 0x7fc1780cf850 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.232+0000 7fc17d3e6640 1 --2- 172.21.15.40:0/3927495262 >> v2:172.21.15.139:3300/0 conn(0x7fc1780d16c0 0x7fc1780cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.232+0000 7fc17d3e6640 1 -- 172.21.15.40:0/3927495262 >> 172.21.15.40:0/3927495262 conn(0x7fc17809d8f0 msgr2=0x7fc1780d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:09.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.232+0000 7fc17d3e6640 1 -- 172.21.15.40:0/3927495262 shutdown_connections 2024-09-21T01:50:09.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.232+0000 7fc17d3e6640 1 -- 172.21.15.40:0/3927495262 wait complete. 2024-09-21T01:50:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.234+0000 7fc17d3e6640 1 Processor -- start 2024-09-21T01:50:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.234+0000 7fc17d3e6640 1 -- start start 2024-09-21T01:50:09.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc17d3e6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780b3a10 0x7fc1781611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc17d3e6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b9b60 0x7fc178156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc17d3e6640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc178160010 0x7fc178156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc17d3e6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc1780d0120 con 0x7fc1780b9b60 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc17d3e6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1780cffa0 con 0x7fc1780b3a10 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc17d3e6640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fc1780d02a0 con 0x7fc178160010 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc1767fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b9b60 0x7fc178156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc1767fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b9b60 0x7fc178156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59734/0 (socket says 172.21.15.40:59734) 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc1767fc640 1 -- 172.21.15.40:0/1770995726 learned_addr learned my addr 172.21.15.40:0/1770995726 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc176ffd640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780b3a10 0x7fc1781611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.235+0000 7fc1777fe640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc178160010 0x7fc178156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc1767fc640 1 -- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc178160010 msgr2=0x7fc178156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc1767fc640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc178160010 0x7fc178156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc1767fc640 1 -- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780b3a10 msgr2=0x7fc1781611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc1767fc640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780b3a10 0x7fc1781611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc1767fc640 1 -- 172.21.15.40:0/1770995726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1780b3310 con 0x7fc1780b9b60 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc1767fc640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b9b60 0x7fc178156aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc16000d6d0 tx=0x7fc16000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc16f7fe640 1 -- 172.21.15.40:0/1770995726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160017070 con 0x7fc1780b9b60 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc16f7fe640 1 -- 172.21.15.40:0/1770995726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc160005330 con 0x7fc1780b9b60 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc178161710 con 0x7fc1780b9b60 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc16f7fe640 1 -- 172.21.15.40:0/1770995726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160009820 con 0x7fc1780b9b60 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.236+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1780b3030 con 0x7fc1780b9b60 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.237+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1780cf310 con 0x7fc1780b9b60 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.238+0000 7fc16f7fe640 1 -- 172.21.15.40:0/1770995726 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc160009bd0 con 0x7fc1780b9b60 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.238+0000 7fc16f7fe640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc158078b90 0x7fc15807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.238+0000 7fc16f7fe640 1 -- 172.21.15.40:0/1770995726 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc16009aff0 con 0x7fc1780b9b60 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.239+0000 7fc176ffd640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc158078b90 0x7fc15807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.239+0000 7fc176ffd640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc158078b90 0x7fc15807b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc170006fd0 tx=0x7fc170009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:09.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.243+0000 7fc16f7fe640 1 -- 172.21.15.40:0/1770995726 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc160062de0 con 0x7fc1780b9b60 2024-09-21T01:50:09.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.448+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc1780caf20 con 0x7fc1780b9b60 2024-09-21T01:50:09.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.448+0000 7fc16f7fe640 1 -- 172.21.15.40:0/1770995726 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fc160067810 con 0x7fc1780b9b60 2024-09-21T01:50:09.449 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-09-21T01:50:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc158078b90 msgr2=0x7fc15807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc158078b90 0x7fc15807b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc170006fd0 tx=0x7fc170009060 comp rx=0 tx=0).stop 2024-09-21T01:50:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b9b60 msgr2=0x7fc178156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b9b60 0x7fc178156aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc16000d6d0 tx=0x7fc16000db90 comp rx=0 tx=0).stop 2024-09-21T01:50:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 shutdown_connections 2024-09-21T01:50:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc158078b90 0x7fc15807b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc178160010 0x7fc178156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780b9b60 0x7fc178156aa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 --2- 172.21.15.40:0/1770995726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1780b3a10 0x7fc1781611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 >> 172.21.15.40:0/1770995726 conn(0x7fc17809d8f0 msgr2=0x7fc1780b73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 shutdown_connections 2024-09-21T01:50:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.450+0000 7fc17d3e6640 1 -- 172.21.15.40:0/1770995726 wait complete. 2024-09-21T01:50:09.462 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-21T01:50:09.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:09.462 DEBUG:teuthology.orchestra.run.smithi139:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-21T01:50:09.494 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi139.front.sepia.ceph.com 2024-09-21T01:50:09.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:09.494 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-21T01:50:09.553 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T01:50:09.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:50:09.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.669+0000 7fe9d2520640 1 -- 172.21.15.40:0/847859152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 msgr2=0x7fe9cc073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.669+0000 7fe9d2520640 1 --2- 172.21.15.40:0/847859152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 0x7fe9cc073400 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4005fd0 tx=0x7fe9c402aa00 comp rx=0 tx=0).stop 2024-09-21T01:50:09.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.669+0000 7fe9d2520640 1 -- 172.21.15.40:0/847859152 shutdown_connections 2024-09-21T01:50:09.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.669+0000 7fe9d2520640 1 --2- 172.21.15.40:0/847859152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 0x7fe9cc073400 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.669+0000 7fe9d2520640 1 --2- 172.21.15.40:0/847859152 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9cc0af780 0x7fe9cc0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.669+0000 7fe9d2520640 1 -- 172.21.15.40:0/847859152 >> 172.21.15.40:0/847859152 conn(0x7fe9cc06d7d0 msgr2=0x7fe9cc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:09.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.669+0000 7fe9d2520640 1 -- 172.21.15.40:0/847859152 shutdown_connections 2024-09-21T01:50:09.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.669+0000 7fe9d2520640 1 -- 172.21.15.40:0/847859152 wait complete. 2024-09-21T01:50:09.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.671+0000 7fe9d2520640 1 Processor -- start 2024-09-21T01:50:09.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.671+0000 7fe9d2520640 1 -- start start 2024-09-21T01:50:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.672+0000 7fe9d2520640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 0x7fe9cc0cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9d2520640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9cc0af780 0x7fe9cc09c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9d2520640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9cc0cd3e0 0x7fe9cc09c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9d2520640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc073d10 con 0x7fe9cc072ff0 2024-09-21T01:50:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9d2520640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc073b90 con 0x7fe9cc0cd3e0 2024-09-21T01:50:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9d2520640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fe9cc15f930 con 0x7fe9cc0af780 2024-09-21T01:50:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 0x7fe9cc0cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:09.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 0x7fe9cc0cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59766/0 (socket says 172.21.15.40:59766) 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cbfff640 1 -- 172.21.15.40:0/835130231 learned_addr learned my addr 172.21.15.40:0/835130231 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9d0abd640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9cc0cd3e0 0x7fe9cc09c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cb7fe640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9cc0af780 0x7fe9cc09c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cbfff640 1 -- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9cc0af780 msgr2=0x7fe9cc09c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cbfff640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9cc0af780 0x7fe9cc09c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cbfff640 1 -- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9cc0cd3e0 msgr2=0x7fe9cc09c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cbfff640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9cc0cd3e0 0x7fe9cc09c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cbfff640 1 -- 172.21.15.40:0/835130231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc1e95d0 con 0x7fe9cc072ff0 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9cbfff640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 0x7fe9cc0cbfc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00c970 tx=0x7fe9bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9c8ff9640 1 -- 172.21.15.40:0/835130231 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc007bb0 con 0x7fe9cc072ff0 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9c8ff9640 1 -- 172.21.15.40:0/835130231 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9bc007e40 con 0x7fe9cc072ff0 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9cc1e9a40 con 0x7fe9cc072ff0 2024-09-21T01:50:09.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9c8ff9640 1 -- 172.21.15.40:0/835130231 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc005280 con 0x7fe9cc072ff0 2024-09-21T01:50:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.673+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9cc1f61c0 con 0x7fe9cc072ff0 2024-09-21T01:50:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.674+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9cc073400 con 0x7fe9cc072ff0 2024-09-21T01:50:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.675+0000 7fe9c8ff9640 1 -- 172.21.15.40:0/835130231 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9bc005420 con 0x7fe9cc072ff0 2024-09-21T01:50:09.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.676+0000 7fe9c8ff9640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9b8078b90 0x7fe9b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.676+0000 7fe9c8ff9640 1 -- 172.21.15.40:0/835130231 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe9bc09b010 con 0x7fe9cc072ff0 2024-09-21T01:50:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.676+0000 7fe9cb7fe640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9b8078b90 0x7fe9b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:09.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.677+0000 7fe9cb7fe640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9b8078b90 0x7fe9b807b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc1f3810 tx=0x7fe9c0009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.680+0000 7fe9c8ff9640 1 -- 172.21.15.40:0/835130231 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe9bc014030 con 0x7fe9cc072ff0 2024-09-21T01:50:09.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.906+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9cc1f5cb0 con 0x7fe9cc072ff0 2024-09-21T01:50:09.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.907+0000 7fe9c8ff9640 1 -- 172.21.15.40:0/835130231 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fe9bc062fe0 con 0x7fe9cc072ff0 2024-09-21T01:50:09.907 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-21T01:49:43:356671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1396929132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1396929132},{"type":"v1","addr":"172.21.15.40:6835","nonce":1396929132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/4017969431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4017969431},{"type":"v1","addr":"172.21.15.139:6836","nonce":4017969431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:49:39.729464+0000","modified":"2024-09-21T01:49:42.736647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6837/1192218063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":1192218063},{"type":"v1","addr":"172.21.15.139:6837","nonce":1192218063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T01:50:09.908 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9b8078b90 msgr2=0x7fe9b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9b8078b90 0x7fe9b807b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc1f3810 tx=0x7fe9c0009060 comp rx=0 tx=0).stop 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 msgr2=0x7fe9cc0cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 0x7fe9cc0cbfc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00c970 tx=0x7fe9bc00ce30 comp rx=0 tx=0).stop 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 shutdown_connections 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9b8078b90 0x7fe9b807b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9cc0cd3e0 0x7fe9cc09c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9cc0af780 0x7fe9cc09c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 --2- 172.21.15.40:0/835130231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9cc072ff0 0x7fe9cc0cbfc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 >> 172.21.15.40:0/835130231 conn(0x7fe9cc06d7d0 msgr2=0x7fe9cc0b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 shutdown_connections 2024-09-21T01:50:09.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:09.909+0000 7fe9d2520640 1 -- 172.21.15.40:0/835130231 wait complete. 2024-09-21T01:50:09.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:50:10.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.037+0000 7faebcebd640 1 -- 172.21.15.40:0/1304242236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80d2ed0 msgr2=0x7faeb80d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.037+0000 7faebcebd640 1 --2- 172.21.15.40:0/1304242236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80d2ed0 0x7faeb80d1a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faeb80d5690 tx=0x7faea802a8b0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.037+0000 7faebcebd640 1 -- 172.21.15.40:0/1304242236 shutdown_connections 2024-09-21T01:50:10.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.037+0000 7faebcebd640 1 --2- 172.21.15.40:0/1304242236 >> v2:172.21.15.139:3300/0 conn(0x7faeb80b9b70 0x7faeb80cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.037+0000 7faebcebd640 1 --2- 172.21.15.40:0/1304242236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80d2ed0 0x7faeb80d1a80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.037+0000 7faebcebd640 1 -- 172.21.15.40:0/1304242236 >> 172.21.15.40:0/1304242236 conn(0x7faeb808bfc0 msgr2=0x7faeb809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:10.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.037+0000 7faebcebd640 1 -- 172.21.15.40:0/1304242236 shutdown_connections 2024-09-21T01:50:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.037+0000 7faebcebd640 1 -- 172.21.15.40:0/1304242236 wait complete. 2024-09-21T01:50:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.039+0000 7faebcebd640 1 Processor -- start 2024-09-21T01:50:10.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.039+0000 7faebcebd640 1 -- start start 2024-09-21T01:50:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.040+0000 7faebcebd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b9b70 0x7faeb809e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.040+0000 7faebcebd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faeb80cf5d0 0x7faeb80a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.040+0000 7faebcebd640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faeb80d2ed0 0x7faeb80a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.040+0000 7faebcebd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faeb80cfe80 con 0x7faeb80b9b70 2024-09-21T01:50:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.040+0000 7faebcebd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faeb80cfd00 con 0x7faeb80cf5d0 2024-09-21T01:50:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.040+0000 7faebcebd640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7faeb80d4940 con 0x7faeb80d2ed0 2024-09-21T01:50:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.040+0000 7faeb659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b9b70 0x7faeb809e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.040+0000 7faeb659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b9b70 0x7faeb809e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59788/0 (socket says 172.21.15.40:59788) 2024-09-21T01:50:10.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.040+0000 7faeb659c640 1 -- 172.21.15.40:0/418942508 learned_addr learned my addr 172.21.15.40:0/418942508 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeb5d9b640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faeb80cf5d0 0x7faeb80a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeb659c640 1 -- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faeb80d2ed0 msgr2=0x7faeb80a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeb659c640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faeb80d2ed0 0x7faeb80a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeb659c640 1 -- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faeb80cf5d0 msgr2=0x7faeb80a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeb659c640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faeb80cf5d0 0x7faeb80a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeb659c640 1 -- 172.21.15.40:0/418942508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb80ca0c0 con 0x7faeb80b9b70 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeb659c640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b9b70 0x7faeb809e650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faea8000f80 tx=0x7faea8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeaeffd640 1 -- 172.21.15.40:0/418942508 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8031850 con 0x7faeb80b9b70 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeaeffd640 1 -- 172.21.15.40:0/418942508 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faea8031ae0 con 0x7faeb80b9b70 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb80ca3a0 con 0x7faeb80b9b70 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faeaeffd640 1 -- 172.21.15.40:0/418942508 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea803b410 con 0x7faeb80b9b70 2024-09-21T01:50:10.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.041+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb80ca960 con 0x7faeb80b9b70 2024-09-21T01:50:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.042+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb80b5cf0 con 0x7faeb80b9b70 2024-09-21T01:50:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.043+0000 7faeaeffd640 1 -- 172.21.15.40:0/418942508 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faea8003d10 con 0x7faeb80b9b70 2024-09-21T01:50:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.043+0000 7faeaeffd640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fae98078b90 0x7fae9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.044+0000 7faeaeffd640 1 -- 172.21.15.40:0/418942508 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faea80bc370 con 0x7faeb80b9b70 2024-09-21T01:50:10.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.044+0000 7faeb5d9b640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fae98078b90 0x7fae9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.044+0000 7faeb5d9b640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fae98078b90 0x7fae9807b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faeb8161260 tx=0x7faea0005c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:10.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.048+0000 7faeaeffd640 1 -- 172.21.15.40:0/418942508 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7faeb80b5cf0 con 0x7faeb80b9b70 2024-09-21T01:50:10.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.274+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faeb806e8f0 con 0x7faeb80b9b70 2024-09-21T01:50:10.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.274+0000 7faeaeffd640 1 -- 172.21.15.40:0/418942508 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7faeb806e8f0 con 0x7faeb80b9b70 2024-09-21T01:50:10.275 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:10.275 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-21T01:49:43:356671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1396929132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1396929132},{"type":"v1","addr":"172.21.15.40:6835","nonce":1396929132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/4017969431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4017969431},{"type":"v1","addr":"172.21.15.139:6836","nonce":4017969431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:49:39.729464+0000","modified":"2024-09-21T01:49:42.736647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6837/1192218063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":1192218063},{"type":"v1","addr":"172.21.15.139:6837","nonce":1192218063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T01:50:10.275 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-21T01:50:10.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.276+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fae98078b90 msgr2=0x7fae9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.276+0000 7faebcebd640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fae98078b90 0x7fae9807b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faeb8161260 tx=0x7faea0005c40 comp rx=0 tx=0).stop 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.276+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b9b70 msgr2=0x7faeb809e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.276+0000 7faebcebd640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b9b70 0x7faeb809e650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faea8000f80 tx=0x7faea8003c20 comp rx=0 tx=0).stop 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.277+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 shutdown_connections 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.277+0000 7faebcebd640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fae98078b90 0x7fae9807b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.277+0000 7faebcebd640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7faeb80d2ed0 0x7faeb80a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.277+0000 7faebcebd640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faeb80cf5d0 0x7faeb80a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.277+0000 7faebcebd640 1 --2- 172.21.15.40:0/418942508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faeb80b9b70 0x7faeb809e650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.277+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 >> 172.21.15.40:0/418942508 conn(0x7faeb808bfc0 msgr2=0x7faeb8068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.277+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 shutdown_connections 2024-09-21T01:50:10.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.277+0000 7faebcebd640 1 -- 172.21.15.40:0/418942508 wait complete. 2024-09-21T01:50:10.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:50:10.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.405+0000 7f1af612b640 1 -- 172.21.15.40:0/610396395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ad8003a00 msgr2=0x7f1ad8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.405+0000 7f1af612b640 1 --2- 172.21.15.40:0/610396395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ad8003a00 0x7f1ad8003e70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009b50 tx=0x7f1ad8005830 comp rx=0 tx=0).stop 2024-09-21T01:50:10.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.405+0000 7f1aeffff640 1 -- 172.21.15.40:0/610396395 reap_dead start 2024-09-21T01:50:10.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.405+0000 7f1af612b640 1 -- 172.21.15.40:0/610396395 shutdown_connections 2024-09-21T01:50:10.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.405+0000 7f1af612b640 1 -- 172.21.15.40:0/610396395 >> 172.21.15.40:0/610396395 conn(0x7f1af008bfc0 msgr2=0x7f1af009d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:10.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.405+0000 7f1af612b640 1 -- 172.21.15.40:0/610396395 shutdown_connections 2024-09-21T01:50:10.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.405+0000 7f1af612b640 1 -- 172.21.15.40:0/610396395 wait complete. 2024-09-21T01:50:10.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.407+0000 7f1af612b640 1 Processor -- start 2024-09-21T01:50:10.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.407+0000 7f1af612b640 1 -- start start 2024-09-21T01:50:10.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.408+0000 7f1af612b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ad8003a00 0x7f1af00cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.408+0000 7f1af612b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1af015ab10 0x7f1af00cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.408+0000 7f1af612b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1af00b26e0 0x7f1af01f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.408+0000 7f1af612b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1af00b41c0 con 0x7f1af00b26e0 2024-09-21T01:50:10.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.408+0000 7f1af612b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1af00b4040 con 0x7f1ad8003a00 2024-09-21T01:50:10.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1af612b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f1af00b4340 con 0x7f1af015ab10 2024-09-21T01:50:10.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1af00b26e0 0x7f1af01f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1af00b26e0 0x7f1af01f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33662/0 (socket says 172.21.15.40:33662) 2024-09-21T01:50:10.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeffff640 1 -- 172.21.15.40:0/2431353636 learned_addr learned my addr 172.21.15.40:0/2431353636 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aef7fe640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ad8003a00 0x7f1af00cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeeffd640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1af015ab10 0x7f1af00cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeffff640 1 -- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1af015ab10 msgr2=0x7f1af00cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeffff640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1af015ab10 0x7f1af00cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeffff640 1 -- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ad8003a00 msgr2=0x7f1af00cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeffff640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ad8003a00 0x7f1af00cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeffff640 1 -- 172.21.15.40:0/2431353636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af015d690 con 0x7f1af00b26e0 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeeffd640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1af015ab10 0x7f1af00cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1aeffff640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1af00b26e0 0x7f1af01f83e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1af008e3a0 tx=0x7f1ae800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1ad7fff640 1 -- 172.21.15.40:0/2431353636 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8004b20 con 0x7f1af00b26e0 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1ad7fff640 1 -- 172.21.15.40:0/2431353636 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ae8004cc0 con 0x7f1af00b26e0 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1ad7fff640 1 -- 172.21.15.40:0/2431353636 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8003bd0 con 0x7f1af00b26e0 2024-09-21T01:50:10.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af015d970 con 0x7f1af00b26e0 2024-09-21T01:50:10.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.409+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af00cdf80 con 0x7f1af00b26e0 2024-09-21T01:50:10.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.410+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1af00b1d10 con 0x7f1af00b26e0 2024-09-21T01:50:10.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.411+0000 7f1ad7fff640 1 -- 172.21.15.40:0/2431353636 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ae8004030 con 0x7f1af00b26e0 2024-09-21T01:50:10.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.412+0000 7f1ad7fff640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1adc078b90 0x7f1adc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.412+0000 7f1ad7fff640 1 -- 172.21.15.40:0/2431353636 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1ae809b160 con 0x7f1af00b26e0 2024-09-21T01:50:10.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.412+0000 7f1aef7fe640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1adc078b90 0x7f1adc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.413+0000 7f1aef7fe640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1adc078b90 0x7f1adc07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0035000 tx=0x7f1ae002d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:10.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.416+0000 7f1ad7fff640 1 -- 172.21.15.40:0/2431353636 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1ae8062fe0 con 0x7f1af00b26e0 2024-09-21T01:50:10.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.607+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1af00b9be0 con 0x7f1af00b26e0 2024-09-21T01:50:10.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.608+0000 7f1ad7fff640 1 -- 172.21.15.40:0/2431353636 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7f1ae8067a10 con 0x7f1af00b26e0 2024-09-21T01:50:10.609 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:10.609 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:41.342237+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:49:37.635417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:49:38.682453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:50:10.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.610+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1adc078b90 msgr2=0x7f1adc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.610+0000 7f1af612b640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1adc078b90 0x7f1adc07b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0035000 tx=0x7f1ae002d040 comp rx=0 tx=0).stop 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1af00b26e0 msgr2=0x7f1af01f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1af00b26e0 0x7f1af01f83e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1af008e3a0 tx=0x7f1ae800f3c0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 shutdown_connections 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1adc078b90 0x7f1adc07b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1af00b26e0 0x7f1af01f83e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f1af015ab10 0x7f1af00cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 --2- 172.21.15.40:0/2431353636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ad8003a00 0x7f1af00cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 >> 172.21.15.40:0/2431353636 conn(0x7f1af008bfc0 msgr2=0x7f1af0161b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 shutdown_connections 2024-09-21T01:50:10.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.611+0000 7f1af612b640 1 -- 172.21.15.40:0/2431353636 wait complete. 2024-09-21T01:50:10.623 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T01:50:10.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:50:10.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.739+0000 7fe9f0798640 1 -- 172.21.15.40:0/851636414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806e170 msgr2=0x7fe9e80b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.739+0000 7fe9f0798640 1 --2- 172.21.15.40:0/851636414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806e170 0x7fe9e80b3540 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009830 tx=0x7fe9e002a530 comp rx=0 tx=0).stop 2024-09-21T01:50:10.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.739+0000 7fe9f0798640 1 -- 172.21.15.40:0/851636414 shutdown_connections 2024-09-21T01:50:10.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.739+0000 7fe9f0798640 1 --2- 172.21.15.40:0/851636414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806e170 0x7fe9e80b3540 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.739+0000 7fe9f0798640 1 -- 172.21.15.40:0/851636414 >> 172.21.15.40:0/851636414 conn(0x7fe9e808bfc0 msgr2=0x7fe9e809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:10.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.739+0000 7fe9f0798640 1 -- 172.21.15.40:0/851636414 shutdown_connections 2024-09-21T01:50:10.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.739+0000 7fe9f0798640 1 -- 172.21.15.40:0/851636414 wait complete. 2024-09-21T01:50:10.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.741+0000 7fe9f0798640 1 Processor -- start 2024-09-21T01:50:10.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.741+0000 7fe9f0798640 1 -- start start 2024-09-21T01:50:10.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.742+0000 7fe9f0798640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806f4b0 0x7fe9e815ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.742+0000 7fe9f0798640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80ceb40 0x7fe9e815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.742+0000 7fe9f0798640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9e815fe20 0x7fe9e80c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.742+0000 7fe9f0798640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e80d1070 con 0x7fe9e806f4b0 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.742+0000 7fe9f0798640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e80d0ef0 con 0x7fe9e80ceb40 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.742+0000 7fe9f0798640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e80d11f0 con 0x7fe9e815fe20 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.742+0000 7fe9ee534640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806f4b0 0x7fe9e815ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.742+0000 7fe9ee534640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806f4b0 0x7fe9e815ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33682/0 (socket says 172.21.15.40:33682) 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.742+0000 7fe9ee534640 1 -- 172.21.15.40:0/1271925785 learned_addr learned my addr 172.21.15.40:0/1271925785 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9edd33640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80ceb40 0x7fe9e815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9eed35640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9e815fe20 0x7fe9e80c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9ee534640 1 -- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9e815fe20 msgr2=0x7fe9e80c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9ee534640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9e815fe20 0x7fe9e80c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9ee534640 1 -- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80ceb40 msgr2=0x7fe9e815f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9ee534640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80ceb40 0x7fe9e815f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9ee534640 1 -- 172.21.15.40:0/1271925785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e8160230 con 0x7fe9e806f4b0 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9eed35640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9e815fe20 0x7fe9e80c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9edd33640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80ceb40 0x7fe9e815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9ee534640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806f4b0 0x7fe9e815ceb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009950 tx=0x7fe9e0033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9e6ffd640 1 -- 172.21.15.40:0/1271925785 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0031b50 con 0x7fe9e806f4b0 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9e6ffd640 1 -- 172.21.15.40:0/1271925785 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9e0031de0 con 0x7fe9e806f4b0 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e80ce0b0 con 0x7fe9e806f4b0 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9e6ffd640 1 -- 172.21.15.40:0/1271925785 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0005280 con 0x7fe9e806f4b0 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.743+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e80ce670 con 0x7fe9e806f4b0 2024-09-21T01:50:10.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.744+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e806a7e0 con 0x7fe9e806f4b0 2024-09-21T01:50:10.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.745+0000 7fe9e6ffd640 1 -- 172.21.15.40:0/1271925785 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9e0005420 con 0x7fe9e806f4b0 2024-09-21T01:50:10.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.745+0000 7fe9e6ffd640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9d4078b90 0x7fe9d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:10.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.745+0000 7fe9e6ffd640 1 -- 172.21.15.40:0/1271925785 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe9e00bbe50 con 0x7fe9e806f4b0 2024-09-21T01:50:10.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.746+0000 7fe9edd33640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9d4078b90 0x7fe9d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:10.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.746+0000 7fe9edd33640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9d4078b90 0x7fe9d407b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80b1530 tx=0x7fe9dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:10.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.750+0000 7fe9e6ffd640 1 -- 172.21.15.40:0/1271925785 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe9e8160230 con 0x7fe9e806f4b0 2024-09-21T01:50:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.977+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9e80c7da0 con 0x7fe9e806f4b0 2024-09-21T01:50:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.978+0000 7fe9e6ffd640 1 -- 172.21.15.40:0/1271925785 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7fe9e003f030 con 0x7fe9e806f4b0 2024-09-21T01:50:10.978 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:10.979 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-21T01:49:43:356671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1396929132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1396929132},{"type":"v1","addr":"172.21.15.40:6835","nonce":1396929132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/4017969431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4017969431},{"type":"v1","addr":"172.21.15.139:6836","nonce":4017969431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:49:39.729464+0000","modified":"2024-09-21T01:49:42.736647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6837/1192218063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":1192218063},{"type":"v1","addr":"172.21.15.139:6837","nonce":1192218063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T01:50:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9d4078b90 msgr2=0x7fe9d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9d4078b90 0x7fe9d407b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80b1530 tx=0x7fe9dc009040 comp rx=0 tx=0).stop 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806f4b0 msgr2=0x7fe9e815ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806f4b0 0x7fe9e815ceb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009950 tx=0x7fe9e0033ba0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 shutdown_connections 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fe9d4078b90 0x7fe9d407b0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fe9e815fe20 0x7fe9e80c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9e80ceb40 0x7fe9e815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 --2- 172.21.15.40:0/1271925785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e806f4b0 0x7fe9e815ceb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 >> 172.21.15.40:0/1271925785 conn(0x7fe9e808bfc0 msgr2=0x7fe9e80d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 shutdown_connections 2024-09-21T01:50:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:10.980+0000 7fe9f0798640 1 -- 172.21.15.40:0/1271925785 wait complete. 2024-09-21T01:50:10.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:50:11.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.108+0000 7f74267a1640 1 -- 172.21.15.40:0/708226034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200ccbd0 msgr2=0x7f74200d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.108+0000 7f74267a1640 1 --2- 172.21.15.40:0/708226034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200ccbd0 0x7f74200d0d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f74200ce170 tx=0x7f740802a560 comp rx=0 tx=0).stop 2024-09-21T01:50:11.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.108+0000 7f74267a1640 1 -- 172.21.15.40:0/708226034 shutdown_connections 2024-09-21T01:50:11.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.108+0000 7f74267a1640 1 --2- 172.21.15.40:0/708226034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200ccbd0 0x7f74200d0d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.108+0000 7f74267a1640 1 --2- 172.21.15.40:0/708226034 >> v2:172.21.15.139:3300/0 conn(0x7f74200d12c0 0x7f74200d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.108+0000 7f74267a1640 1 --2- 172.21.15.40:0/708226034 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74200b51c0 0x7f742015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.108+0000 7f74267a1640 1 -- 172.21.15.40:0/708226034 >> 172.21.15.40:0/708226034 conn(0x7f7420072ae0 msgr2=0x7f7420072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:11.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.108+0000 7f74267a1640 1 -- 172.21.15.40:0/708226034 shutdown_connections 2024-09-21T01:50:11.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.108+0000 7f74267a1640 1 -- 172.21.15.40:0/708226034 wait complete. 2024-09-21T01:50:11.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.109+0000 7f74267a1640 1 Processor -- start 2024-09-21T01:50:11.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.110+0000 7f74267a1640 1 -- start start 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f74267a1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200b51c0 0x7f742014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f74267a1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74200ccbd0 0x7f742014ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f74267a1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74200d12c0 0x7f742014d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f74267a1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f74201607f0 con 0x7f74200b51c0 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f74267a1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7420160670 con 0x7f74200ccbd0 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f74267a1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f7420160970 con 0x7f74200d12c0 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f741ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200b51c0 0x7f742014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f741ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200b51c0 0x7f742014e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33696/0 (socket says 172.21.15.40:33696) 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f741ffff640 1 -- 172.21.15.40:0/3880573096 learned_addr learned my addr 172.21.15.40:0/3880573096 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f7417fff640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74200ccbd0 0x7f742014ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f7424d3e640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74200d12c0 0x7f742014d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f741ffff640 1 -- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74200d12c0 msgr2=0x7f742014d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f741ffff640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74200d12c0 0x7f742014d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f741ffff640 1 -- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74200ccbd0 msgr2=0x7f742014ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f741ffff640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74200ccbd0 0x7f742014ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f741ffff640 1 -- 172.21.15.40:0/3880573096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742014c890 con 0x7f74200b51c0 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f7424d3e640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74200d12c0 0x7f742014d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.111+0000 7f741ffff640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200b51c0 0x7f742014e7f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f741000d750 tx=0x7f741000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.112+0000 7f741d7fa640 1 -- 172.21.15.40:0/3880573096 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410017070 con 0x7f74200b51c0 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.112+0000 7f741d7fa640 1 -- 172.21.15.40:0/3880573096 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7410009cc0 con 0x7f74200b51c0 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.112+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742014cb70 con 0x7f74200b51c0 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.112+0000 7f741d7fa640 1 -- 172.21.15.40:0/3880573096 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74100106c0 con 0x7f74200b51c0 2024-09-21T01:50:11.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.112+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742014d130 con 0x7f74200b51c0 2024-09-21T01:50:11.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.113+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74200d16d0 con 0x7f74200b51c0 2024-09-21T01:50:11.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.114+0000 7f741d7fa640 1 -- 172.21.15.40:0/3880573096 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f741001a070 con 0x7f74200b51c0 2024-09-21T01:50:11.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.114+0000 7f741d7fa640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7400078b90 0x7f740007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.114+0000 7f741d7fa640 1 -- 172.21.15.40:0/3880573096 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f741009ada0 con 0x7f74200b51c0 2024-09-21T01:50:11.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.114+0000 7f7417fff640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7400078b90 0x7f740007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.115+0000 7f7417fff640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7400078b90 0x7f740007b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7408033000 tx=0x7f7408004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:11.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.119+0000 7f741d7fa640 1 -- 172.21.15.40:0/3880573096 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f741000de60 con 0x7f74200b51c0 2024-09-21T01:50:11.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.344+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f742015bd70 con 0x7f74200b51c0 2024-09-21T01:50:11.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.344+0000 7f741d7fa640 1 -- 172.21.15.40:0/3880573096 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5223 (secure 0 0 0) 0x7f7410062c20 con 0x7f74200b51c0 2024-09-21T01:50:11.345 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:11.345 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"btime":"2024-09-21T01:49:43:356671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1396929132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1396929132},{"type":"v1","addr":"172.21.15.40:6835","nonce":1396929132}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4304,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/4017969431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4017969431},{"type":"v1","addr":"172.21.15.139:6836","nonce":4017969431}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1599175825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1599175825},{"type":"v1","addr":"172.21.15.40:6834","nonce":1599175825}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:49:39.729464+0000","modified":"2024-09-21T01:49:42.736647+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.139:6837/1192218063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":1192218063},{"type":"v1","addr":"172.21.15.139:6837","nonce":1192218063}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T01:50:11.345 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-21T01:50:11.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.346+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7400078b90 msgr2=0x7f740007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.346+0000 7f74267a1640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7400078b90 0x7f740007b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7408033000 tx=0x7f7408004730 comp rx=0 tx=0).stop 2024-09-21T01:50:11.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.346+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200b51c0 msgr2=0x7f742014e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.346+0000 7f74267a1640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200b51c0 0x7f742014e7f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f741000d750 tx=0x7f741000dc10 comp rx=0 tx=0).stop 2024-09-21T01:50:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.346+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 shutdown_connections 2024-09-21T01:50:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.347+0000 7f74267a1640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f7400078b90 0x7f740007b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.347+0000 7f74267a1640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f74200d12c0 0x7f742014d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.347+0000 7f74267a1640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f74200ccbd0 0x7f742014ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.347+0000 7f74267a1640 1 --2- 172.21.15.40:0/3880573096 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74200b51c0 0x7f742014e7f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.347+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 >> 172.21.15.40:0/3880573096 conn(0x7f7420072ae0 msgr2=0x7f742015ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.347+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 shutdown_connections 2024-09-21T01:50:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.347+0000 7f74267a1640 1 -- 172.21.15.40:0/3880573096 wait complete. 2024-09-21T01:50:11.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:50:11.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.478+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/2328805069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9e0004d40 msgr2=0x7fc9e0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.478+0000 7fc9fd9a1640 1 --2- 172.21.15.40:0/2328805069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9e0004d40 0x7fc9e0005150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0006fd0 tx=0x7fc9e0005830 comp rx=0 tx=0).stop 2024-09-21T01:50:11.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.478+0000 7fc9f77fe640 1 -- 172.21.15.40:0/2328805069 reap_dead start 2024-09-21T01:50:11.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.478+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/2328805069 shutdown_connections 2024-09-21T01:50:11.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.478+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/2328805069 >> 172.21.15.40:0/2328805069 conn(0x7fc9f80d12a0 msgr2=0x7fc9f80d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:11.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.478+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/2328805069 shutdown_connections 2024-09-21T01:50:11.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.478+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/2328805069 wait complete. 2024-09-21T01:50:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.480+0000 7fc9fd9a1640 1 Processor -- start 2024-09-21T01:50:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.480+0000 7fc9fd9a1640 1 -- start start 2024-09-21T01:50:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.481+0000 7fc9fd9a1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9e0004d40 0x7fc9f815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.481+0000 7fc9fd9a1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9f80c9830 0x7fc9f80c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.481+0000 7fc9fd9a1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f80c76e0 0x7fc9f80c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.481+0000 7fc9fd9a1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f80b20d0 con 0x7fc9e0004d40 2024-09-21T01:50:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.481+0000 7fc9fd9a1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f80b19a0 con 0x7fc9f80c76e0 2024-09-21T01:50:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.481+0000 7fc9fd9a1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f80b0de0 con 0x7fc9f80c9830 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9e0004d40 0x7fc9f815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9e0004d40 0x7fc9f815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33724/0 (socket says 172.21.15.40:33724) 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f6ffd640 1 -- 172.21.15.40:0/385501327 learned_addr learned my addr 172.21.15.40:0/385501327 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f67fc640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9f80c9830 0x7fc9f80c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f77fe640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f80c76e0 0x7fc9f80c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f6ffd640 1 -- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9f80c9830 msgr2=0x7fc9f80c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f6ffd640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9f80c9830 0x7fc9f80c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f6ffd640 1 -- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f80c76e0 msgr2=0x7fc9f80c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f6ffd640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f80c76e0 0x7fc9f80c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f6ffd640 1 -- 172.21.15.40:0/385501327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f81f6a70 con 0x7fc9e0004d40 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9f6ffd640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9e0004d40 0x7fc9f815bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80118e0 tx=0x7fc9e8011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9dffff640 1 -- 172.21.15.40:0/385501327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e801e070 con 0x7fc9e0004d40 2024-09-21T01:50:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f80c8030 con 0x7fc9e0004d40 2024-09-21T01:50:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9dffff640 1 -- 172.21.15.40:0/385501327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9e800fd30 con 0x7fc9e0004d40 2024-09-21T01:50:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9dffff640 1 -- 172.21.15.40:0/385501327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8019690 con 0x7fc9e0004d40 2024-09-21T01:50:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.482+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f806d1f0 con 0x7fc9e0004d40 2024-09-21T01:50:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.484+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f8161cf0 con 0x7fc9e0004d40 2024-09-21T01:50:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.484+0000 7fc9dffff640 1 -- 172.21.15.40:0/385501327 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9e8021070 con 0x7fc9e0004d40 2024-09-21T01:50:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.485+0000 7fc9dffff640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc9e4078b90 0x7fc9e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.485+0000 7fc9dffff640 1 -- 172.21.15.40:0/385501327 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc9e809b690 con 0x7fc9e0004d40 2024-09-21T01:50:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.485+0000 7fc9f67fc640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc9e4078b90 0x7fc9e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.485+0000 7fc9f67fc640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc9e4078b90 0x7fc9e407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80b3ad0 tx=0x7fc9ec005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.489+0000 7fc9dffff640 1 -- 172.21.15.40:0/385501327 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc9f8161cf0 con 0x7fc9e0004d40 2024-09-21T01:50:11.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.679+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9f8069450 con 0x7fc9e0004d40 2024-09-21T01:50:11.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.680+0000 7fc9dffff640 1 -- 172.21.15.40:0/385501327 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16677 (secure 0 0 0) 0x7fc9f8069450 con 0x7fc9e0004d40 2024-09-21T01:50:11.681 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:11.681 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":21,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:49:41.342237+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:49:37.635417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:49:38.682453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:50:11.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.682+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc9e4078b90 msgr2=0x7fc9e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.682+0000 7fc9fd9a1640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc9e4078b90 0x7fc9e407b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80b3ad0 tx=0x7fc9ec005f90 comp rx=0 tx=0).stop 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.682+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9e0004d40 msgr2=0x7fc9f815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.682+0000 7fc9fd9a1640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9e0004d40 0x7fc9f815bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80118e0 tx=0x7fc9e8011ce0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.683+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 shutdown_connections 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.683+0000 7fc9fd9a1640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc9e4078b90 0x7fc9e407b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.683+0000 7fc9fd9a1640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9f80c76e0 0x7fc9f80c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.683+0000 7fc9fd9a1640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc9f80c9830 0x7fc9f80c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.683+0000 7fc9fd9a1640 1 --2- 172.21.15.40:0/385501327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9e0004d40 0x7fc9f815bf30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.683+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 >> 172.21.15.40:0/385501327 conn(0x7fc9f80d12a0 msgr2=0x7fc9f80715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.683+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 shutdown_connections 2024-09-21T01:50:11.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.683+0000 7fc9fd9a1640 1 -- 172.21.15.40:0/385501327 wait complete. 2024-09-21T01:50:11.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T01:50:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.829+0000 7fdf79fb0640 1 -- 172.21.15.40:0/525061902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf740d1450 msgr2=0x7fdf741673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.829+0000 7fdf79fb0640 1 --2- 172.21.15.40:0/525061902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf740d1450 0x7fdf741673c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c005fd0 tx=0x7fdf6c02aaa0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.829+0000 7fdf79fb0640 1 -- 172.21.15.40:0/525061902 shutdown_connections 2024-09-21T01:50:11.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.829+0000 7fdf79fb0640 1 --2- 172.21.15.40:0/525061902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf740d1450 0x7fdf741673c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.829+0000 7fdf79fb0640 1 -- 172.21.15.40:0/525061902 >> 172.21.15.40:0/525061902 conn(0x7fdf7406def0 msgr2=0x7fdf7406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:11.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.829+0000 7fdf79fb0640 1 -- 172.21.15.40:0/525061902 shutdown_connections 2024-09-21T01:50:11.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.829+0000 7fdf79fb0640 1 -- 172.21.15.40:0/525061902 wait complete. 2024-09-21T01:50:11.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.830+0000 7fdf79fb0640 1 Processor -- start 2024-09-21T01:50:11.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.831+0000 7fdf79fb0640 1 -- start start 2024-09-21T01:50:11.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf79fb0640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf7406cde0 0x7fdf7415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf79fb0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf740d1450 0x7fdf7415b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf79fb0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf74142e60 0x7fdf741539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf79fb0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf74167c90 con 0x7fdf74142e60 2024-09-21T01:50:11.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf79fb0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdf74167b10 con 0x7fdf740d1450 2024-09-21T01:50:11.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf79fb0640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fdf74167e10 con 0x7fdf7406cde0 2024-09-21T01:50:11.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf74142e60 0x7fdf741539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf74142e60 0x7fdf741539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33744/0 (socket says 172.21.15.40:33744) 2024-09-21T01:50:11.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf73fff640 1 -- 172.21.15.40:0/2444866149 learned_addr learned my addr 172.21.15.40:0/2444866149 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:11.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf72ffd640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf740d1450 0x7fdf7415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf737fe640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf7406cde0 0x7fdf7415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf73fff640 1 -- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf7406cde0 msgr2=0x7fdf7415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf73fff640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf7406cde0 0x7fdf7415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf73fff640 1 -- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf740d1450 msgr2=0x7fdf7415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:11.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf73fff640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf740d1450 0x7fdf7415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:11.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf73fff640 1 -- 172.21.15.40:0/2444866149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7415a420 con 0x7fdf74142e60 2024-09-21T01:50:11.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.832+0000 7fdf737fe640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf7406cde0 0x7fdf7415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:11.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.833+0000 7fdf73fff640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf74142e60 0x7fdf741539e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009bf0 tx=0x7fdf6c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:11.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.833+0000 7fdf5bfff640 1 -- 172.21.15.40:0/2444866149 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c044070 con 0x7fdf74142e60 2024-09-21T01:50:11.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.833+0000 7fdf5bfff640 1 -- 172.21.15.40:0/2444866149 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf6c004250 con 0x7fdf74142e60 2024-09-21T01:50:11.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.833+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7415a700 con 0x7fdf74142e60 2024-09-21T01:50:11.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.833+0000 7fdf5bfff640 1 -- 172.21.15.40:0/2444866149 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0046a0 con 0x7fdf74142e60 2024-09-21T01:50:11.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.833+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7412a500 con 0x7fdf74142e60 2024-09-21T01:50:11.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.834+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7413e820 con 0x7fdf74142e60 2024-09-21T01:50:11.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.835+0000 7fdf5bfff640 1 -- 172.21.15.40:0/2444866149 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf6c047070 con 0x7fdf74142e60 2024-09-21T01:50:11.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.836+0000 7fdf5bfff640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdf60078bc0 0x7fdf6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:11.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.836+0000 7fdf5bfff640 1 -- 172.21.15.40:0/2444866149 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdf6c0bbcd0 con 0x7fdf74142e60 2024-09-21T01:50:11.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.836+0000 7fdf737fe640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdf60078bc0 0x7fdf6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:11.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.837+0000 7fdf737fe640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdf60078bc0 0x7fdf6007b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf64000f60 tx=0x7fdf64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:11.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:11.840+0000 7fdf5bfff640 1 -- 172.21.15.40:0/2444866149 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdf6c032030 con 0x7fdf74142e60 2024-09-21T01:50:12.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.090+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdf7412a760 con 0x7fdf74142e60 2024-09-21T01:50:12.091 INFO:tasks.ceph.mon.a.smithi040.stderr:2024-09-21T01:50:12.090+0000 7f11d5e93640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:50:12.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.092+0000 7fdf5bfff640 1 -- 172.21.15.40:0/2444866149 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fdf6c083ad0 con 0x7fdf74142e60 2024-09-21T01:50:12.092 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T01:50:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdf60078bc0 msgr2=0x7fdf6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdf60078bc0 0x7fdf6007b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdf64000f60 tx=0x7fdf64009040 comp rx=0 tx=0).stop 2024-09-21T01:50:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf74142e60 msgr2=0x7fdf741539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf74142e60 0x7fdf741539e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009bf0 tx=0x7fdf6c003f10 comp rx=0 tx=0).stop 2024-09-21T01:50:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 shutdown_connections 2024-09-21T01:50:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdf60078bc0 0x7fdf6007b0d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf74142e60 0x7fdf741539e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf740d1450 0x7fdf7415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:12.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 --2- 172.21.15.40:0/2444866149 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdf7406cde0 0x7fdf7415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 >> 172.21.15.40:0/2444866149 conn(0x7fdf7406def0 msgr2=0x7fdf7413f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 shutdown_connections 2024-09-21T01:50:12.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.095+0000 7fdf79fb0640 1 -- 172.21.15.40:0/2444866149 wait complete. 2024-09-21T01:50:12.101 INFO:tasks.ceph.mds.b.smithi139.stderr: -6952> 2024-09-21T01:49:46.318+0000 7f5106b53640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T01:50:12.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T01:50:12.160 INFO:tasks.ceph.mds.b.smithi139.stdout:starting mds.b at 2024-09-21T01:50:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.227+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2693468331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c004800 msgr2=0x7f9b8c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.227+0000 7f9ba7b2b640 1 --2- 172.21.15.40:0/2693468331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b8c004800 0x7f9b8c004c10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009b50 tx=0x7f9b8c005830 comp rx=0 tx=0).stop 2024-09-21T01:50:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.227+0000 7f9ba60c8640 1 -- 172.21.15.40:0/2693468331 reap_dead start 2024-09-21T01:50:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.227+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2693468331 shutdown_connections 2024-09-21T01:50:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.227+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2693468331 >> 172.21.15.40:0/2693468331 conn(0x7f9ba006def0 msgr2=0x7f9ba006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.227+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2693468331 shutdown_connections 2024-09-21T01:50:12.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.227+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2693468331 wait complete. 2024-09-21T01:50:12.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.229+0000 7f9ba7b2b640 1 Processor -- start 2024-09-21T01:50:12.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.229+0000 7f9ba7b2b640 1 -- start start 2024-09-21T01:50:12.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.230+0000 7f9ba7b2b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b8c004800 0x7f9ba006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:12.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.230+0000 7f9ba7b2b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba006d500 0x7f9ba014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:12.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.230+0000 7f9ba7b2b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ba014eb80 0x7f9ba0148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:12.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.230+0000 7f9ba7b2b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba00708b0 con 0x7f9ba006d500 2024-09-21T01:50:12.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.230+0000 7f9ba7b2b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0070120 con 0x7f9b8c004800 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.230+0000 7f9ba7b2b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f9ba0070a30 con 0x7f9ba014eb80 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.230+0000 7f9ba50c6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba006d500 0x7f9ba014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba50c6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba006d500 0x7f9ba014e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33768/0 (socket says 172.21.15.40:33768) 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba50c6640 1 -- 172.21.15.40:0/2147718877 learned_addr learned my addr 172.21.15.40:0/2147718877 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba58c7640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b8c004800 0x7f9ba006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba60c8640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ba014eb80 0x7f9ba0148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba50c6640 1 -- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ba014eb80 msgr2=0x7f9ba0148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba50c6640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ba014eb80 0x7f9ba0148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba50c6640 1 -- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b8c004800 msgr2=0x7f9ba006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba50c6640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b8c004800 0x7f9ba006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba50c6640 1 -- 172.21.15.40:0/2147718877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba014e2b0 con 0x7f9ba006d500 2024-09-21T01:50:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba58c7640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b8c004800 0x7f9ba006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba50c6640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba006d500 0x7f9ba014e640 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009c70 tx=0x7f9b90033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9b967fc640 1 -- 172.21.15.40:0/2147718877 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90038040 con 0x7f9ba006d500 2024-09-21T01:50:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9b967fc640 1 -- 172.21.15.40:0/2147718877 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b90004020 con 0x7f9ba006d500 2024-09-21T01:50:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba014da10 con 0x7f9ba006d500 2024-09-21T01:50:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9b967fc640 1 -- 172.21.15.40:0/2147718877 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90004450 con 0x7f9ba006d500 2024-09-21T01:50:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.231+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba014dfd0 con 0x7f9ba006d500 2024-09-21T01:50:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.233+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba015c580 con 0x7f9ba006d500 2024-09-21T01:50:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.233+0000 7f9b967fc640 1 -- 172.21.15.40:0/2147718877 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b90045020 con 0x7f9ba006d500 2024-09-21T01:50:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.234+0000 7f9b967fc640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b84078b90 0x7f9b8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.234+0000 7f9b967fc640 1 -- 172.21.15.40:0/2147718877 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f9b900bb890 con 0x7f9ba006d500 2024-09-21T01:50:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.234+0000 7f9ba58c7640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b84078b90 0x7f9b8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:12.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.235+0000 7f9ba58c7640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b84078b90 0x7f9b8407b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c005eb0 tx=0x7f9b9c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:12.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.239+0000 7f9b967fc640 1 -- 172.21.15.40:0/2147718877 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9b90083c70 con 0x7f9ba006d500 2024-09-21T01:50:12.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:12.469+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9ba014d7a0 con 0x7f9ba006d500 2024-09-21T01:50:13.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.093+0000 7f9b967fc640 1 -- 172.21.15.40:0/2147718877 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f9b90083570 con 0x7f9ba006d500 2024-09-21T01:50:13.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b84078b90 msgr2=0x7f9b8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:13.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b84078b90 0x7f9b8407b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c005eb0 tx=0x7f9b9c005f90 comp rx=0 tx=0).stop 2024-09-21T01:50:13.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba006d500 msgr2=0x7f9ba014e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:13.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba006d500 0x7f9ba014e640 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009c70 tx=0x7f9b90033670 comp rx=0 tx=0).stop 2024-09-21T01:50:13.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 shutdown_connections 2024-09-21T01:50:13.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9b84078b90 0x7f9b8407b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:13.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f9ba014eb80 0x7f9ba0148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:13.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ba006d500 0x7f9ba014e640 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:13.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 --2- 172.21.15.40:0/2147718877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9b8c004800 0x7f9ba006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:13.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 >> 172.21.15.40:0/2147718877 conn(0x7f9ba006def0 msgr2=0x7f9ba0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:13.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 shutdown_connections 2024-09-21T01:50:13.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.096+0000 7f9ba7b2b640 1 -- 172.21.15.40:0/2147718877 wait complete. 2024-09-21T01:50:13.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T01:50:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.234+0000 7fac2f3df640 1 -- 172.21.15.40:0/648325353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 msgr2=0x7fac280d1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.234+0000 7fac2f3df640 1 --2- 172.21.15.40:0/648325353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 0x7fac280d1230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fac18009830 tx=0x7fac1802a480 comp rx=0 tx=0).stop 2024-09-21T01:50:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.234+0000 7fac2f3df640 1 -- 172.21.15.40:0/648325353 shutdown_connections 2024-09-21T01:50:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.234+0000 7fac2f3df640 1 --2- 172.21.15.40:0/648325353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 0x7fac280d1230 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.234+0000 7fac2f3df640 1 --2- 172.21.15.40:0/648325353 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac2806e0f0 0x7fac2806f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.234+0000 7fac2f3df640 1 -- 172.21.15.40:0/648325353 >> 172.21.15.40:0/648325353 conn(0x7fac2809d800 msgr2=0x7fac2808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:13.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.234+0000 7fac2f3df640 1 -- 172.21.15.40:0/648325353 shutdown_connections 2024-09-21T01:50:13.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.234+0000 7fac2f3df640 1 -- 172.21.15.40:0/648325353 wait complete. 2024-09-21T01:50:13.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.236+0000 7fac2f3df640 1 Processor -- start 2024-09-21T01:50:13.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.236+0000 7fac2f3df640 1 -- start start 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2f3df640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac2806e0f0 0x7fac281d6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2f3df640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac280b5f60 0x7fac2809e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2f3df640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 0x7fac280b8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2f3df640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fac280b6a80 con 0x7fac280d0e20 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2f3df640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fac280d3e90 con 0x7fac280b5f60 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2f3df640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fac280b6c00 con 0x7fac2806e0f0 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2d97c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 0x7fac280b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2d97c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 0x7fac280b8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33778/0 (socket says 172.21.15.40:33778) 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2d97c640 1 -- 172.21.15.40:0/897443015 learned_addr learned my addr 172.21.15.40:0/897443015 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:13.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2d17b640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac2806e0f0 0x7fac281d6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.237+0000 7fac2c97a640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac280b5f60 0x7fac2809e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac2d97c640 1 -- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac2806e0f0 msgr2=0x7fac281d6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac2d97c640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac2806e0f0 0x7fac281d6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac2d97c640 1 -- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac280b5f60 msgr2=0x7fac2809e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac2d97c640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac280b5f60 0x7fac2809e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac2d97c640 1 -- 172.21.15.40:0/897443015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac280a0030 con 0x7fac280d0e20 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac2d97c640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 0x7fac280b8360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c3c0 tx=0x7fac2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac1dffb640 1 -- 172.21.15.40:0/897443015 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20017070 con 0x7fac280d0e20 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac1dffb640 1 -- 172.21.15.40:0/897443015 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac200035f0 con 0x7fac280d0e20 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac280a0310 con 0x7fac280d0e20 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac1dffb640 1 -- 172.21.15.40:0/897443015 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20003a40 con 0x7fac280d0e20 2024-09-21T01:50:13.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.238+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac280a08d0 con 0x7fac280d0e20 2024-09-21T01:50:13.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.239+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2806f3f0 con 0x7fac280d0e20 2024-09-21T01:50:13.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.240+0000 7fac1dffb640 1 -- 172.21.15.40:0/897443015 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac2001a070 con 0x7fac280d0e20 2024-09-21T01:50:13.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.240+0000 7fac1dffb640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac0c078b90 0x7fac0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:13.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.241+0000 7fac1dffb640 1 -- 172.21.15.40:0/897443015 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7fac20099f40 con 0x7fac280d0e20 2024-09-21T01:50:13.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.241+0000 7fac2d17b640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac0c078b90 0x7fac0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:13.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.241+0000 7fac2d17b640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac0c078b90 0x7fac0c07b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fac2808d450 tx=0x7fac2400a590 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:13.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.245+0000 7fac1dffb640 1 -- 172.21.15.40:0/897443015 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fac280d1770 con 0x7fac280d0e20 2024-09-21T01:50:13.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:13.440+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac280cac40 con 0x7fac280d0e20 2024-09-21T01:50:14.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.436+0000 7fac1dffb640 1 -- 172.21.15.40:0/897443015 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7fac20066660 con 0x7fac280d0e20 2024-09-21T01:50:14.437 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2024-09-21T01:50:14.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.441+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac0c078b90 msgr2=0x7fac0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:14.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.441+0000 7fac2f3df640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac0c078b90 0x7fac0c07b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fac2808d450 tx=0x7fac2400a590 comp rx=0 tx=0).stop 2024-09-21T01:50:14.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.441+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 msgr2=0x7fac280b8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:14.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.441+0000 7fac2f3df640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 0x7fac280b8360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c3c0 tx=0x7fac2000c880 comp rx=0 tx=0).stop 2024-09-21T01:50:14.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.442+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 shutdown_connections 2024-09-21T01:50:14.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.442+0000 7fac2f3df640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac0c078b90 0x7fac0c07b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:14.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.442+0000 7fac2f3df640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac280d0e20 0x7fac280b8360 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:14.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.442+0000 7fac2f3df640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac280b5f60 0x7fac2809e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:14.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.442+0000 7fac2f3df640 1 --2- 172.21.15.40:0/897443015 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac2806e0f0 0x7fac281d6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:14.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.442+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 >> 172.21.15.40:0/897443015 conn(0x7fac2809d800 msgr2=0x7fac281e6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:14.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.442+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 shutdown_connections 2024-09-21T01:50:14.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.442+0000 7fac2f3df640 1 -- 172.21.15.40:0/897443015 wait complete. 2024-09-21T01:50:14.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T01:50:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.585+0000 7fd3a2884640 1 -- 172.21.15.40:0/3820269058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd384003a00 msgr2=0x7fd384003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.585+0000 7fd3a2884640 1 --2- 172.21.15.40:0/3820269058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd384003a00 0x7fd384003e90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00c290 tx=0x7fd384005830 comp rx=0 tx=0).stop 2024-09-21T01:50:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.585+0000 7fd3a0e21640 1 -- 172.21.15.40:0/3820269058 reap_dead start 2024-09-21T01:50:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.585+0000 7fd3a2884640 1 -- 172.21.15.40:0/3820269058 shutdown_connections 2024-09-21T01:50:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.585+0000 7fd3a2884640 1 -- 172.21.15.40:0/3820269058 >> 172.21.15.40:0/3820269058 conn(0x7fd39c0ced80 msgr2=0x7fd39c0cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.585+0000 7fd3a2884640 1 -- 172.21.15.40:0/3820269058 shutdown_connections 2024-09-21T01:50:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.585+0000 7fd3a2884640 1 -- 172.21.15.40:0/3820269058 wait complete. 2024-09-21T01:50:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.587+0000 7fd3a2884640 1 Processor -- start 2024-09-21T01:50:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.587+0000 7fd3a2884640 1 -- start start 2024-09-21T01:50:14.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a2884640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd384003a00 0x7fd39c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a2884640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39c158c00 0x7fd39c1fd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a2884640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd39c156650 0x7fd39c1fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a2884640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c0b1b60 con 0x7fd39c156650 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a2884640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd39c0b1940 con 0x7fd39c158c00 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a2884640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fd39c0b1ce0 con 0x7fd384003a00 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a0e21640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd39c156650 0x7fd39c1fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a0e21640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd39c156650 0x7fd39c1fd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33796/0 (socket says 172.21.15.40:33796) 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a0e21640 1 -- 172.21.15.40:0/2999956289 learned_addr learned my addr 172.21.15.40:0/2999956289 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd39b7fe640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39c158c00 0x7fd39c1fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd39bfff640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd384003a00 0x7fd39c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a0e21640 1 -- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd384003a00 msgr2=0x7fd39c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a0e21640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd384003a00 0x7fd39c154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:14.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a0e21640 1 -- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39c158c00 msgr2=0x7fd39c1fd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:14.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a0e21640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39c158c00 0x7fd39c1fd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:14.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a0e21640 1 -- 172.21.15.40:0/2999956289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39c1fde90 con 0x7fd39c156650 2024-09-21T01:50:14.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a0e21640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd39c156650 0x7fd39c1fd5c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd39c075540 tx=0x7fd394010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:14.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd398ff9640 1 -- 172.21.15.40:0/2999956289 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39400ee10 con 0x7fd39c156650 2024-09-21T01:50:14.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39c15fef0 con 0x7fd39c156650 2024-09-21T01:50:14.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd398ff9640 1 -- 172.21.15.40:0/2999956289 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd394015070 con 0x7fd39c156650 2024-09-21T01:50:14.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd398ff9640 1 -- 172.21.15.40:0/2999956289 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd394003d40 con 0x7fd39c156650 2024-09-21T01:50:14.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.589+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd39c15fbe0 con 0x7fd39c156650 2024-09-21T01:50:14.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.591+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39c0b24b0 con 0x7fd39c156650 2024-09-21T01:50:14.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.591+0000 7fd398ff9640 1 -- 172.21.15.40:0/2999956289 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd394004030 con 0x7fd39c156650 2024-09-21T01:50:14.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.592+0000 7fd398ff9640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd388078bc0 0x7fd38807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:14.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.592+0000 7fd398ff9640 1 -- 172.21.15.40:0/2999956289 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7fd39409b6c0 con 0x7fd39c156650 2024-09-21T01:50:14.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.592+0000 7fd39bfff640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd388078bc0 0x7fd38807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:14.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.593+0000 7fd39bfff640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd388078bc0 0x7fd38807b0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd38c033000 tx=0x7fd38c02d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:14.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.596+0000 7fd398ff9640 1 -- 172.21.15.40:0/2999956289 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd394063be0 con 0x7fd39c156650 2024-09-21T01:50:14.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:14.789+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd39c072210 con 0x7fd39c156650 2024-09-21T01:50:15.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.442+0000 7fd398ff9640 1 -- 172.21.15.40:0/2999956289 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7fd3940634e0 con 0x7fd39c156650 2024-09-21T01:50:15.443 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2024-09-21T01:50:15.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.448+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd388078bc0 msgr2=0x7fd38807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:15.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.448+0000 7fd3a2884640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd388078bc0 0x7fd38807b0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd38c033000 tx=0x7fd38c02d000 comp rx=0 tx=0).stop 2024-09-21T01:50:15.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.448+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd39c156650 msgr2=0x7fd39c1fd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:15.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.448+0000 7fd3a2884640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd39c156650 0x7fd39c1fd5c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd39c075540 tx=0x7fd394010f40 comp rx=0 tx=0).stop 2024-09-21T01:50:15.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.449+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 shutdown_connections 2024-09-21T01:50:15.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.449+0000 7fd3a2884640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fd388078bc0 0x7fd38807b0d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:15.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.449+0000 7fd3a2884640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd39c156650 0x7fd39c1fd5c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:15.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.449+0000 7fd3a2884640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd39c158c00 0x7fd39c1fd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:15.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.449+0000 7fd3a2884640 1 --2- 172.21.15.40:0/2999956289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fd384003a00 0x7fd39c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.449+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 >> 172.21.15.40:0/2999956289 conn(0x7fd39c0ced80 msgr2=0x7fd39c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.450+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 shutdown_connections 2024-09-21T01:50:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.450+0000 7fd3a2884640 1 -- 172.21.15.40:0/2999956289 wait complete. 2024-09-21T01:50:15.467 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T01:50:15.467 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T01:50:15.467 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T01:50:15.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T01:50:15.467 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T01:50:15.467 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T01:50:15.468 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T01:50:15.468 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T01:50:15.468 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T01:50:15.468 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T01:50:15.468 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T01:50:15.468 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T01:50:15.468 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T01:50:15.468 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T01:50:15.469 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T01:50:15.469 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T01:50:15.478 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T01:50:15.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T01:50:15.479 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T01:50:15.479 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T01:50:15.481 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T01:50:15.481 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T01:50:15.482 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T01:50:15.482 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T01:50:15.521 INFO:tasks.ceph.mds.a:Started 2024-09-21T01:50:15.521 DEBUG:teuthology.parallel:result is None 2024-09-21T01:50:15.522 INFO:tasks.ceph.mds.c:Started 2024-09-21T01:50:15.522 DEBUG:teuthology.parallel:result is None 2024-09-21T01:50:15.524 INFO:tasks.ceph.mds.d:Started 2024-09-21T01:50:15.524 DEBUG:teuthology.parallel:result is None 2024-09-21T01:50:15.525 INFO:tasks.ceph.mds.b:Started 2024-09-21T01:50:15.525 DEBUG:teuthology.parallel:result is None 2024-09-21T01:50:15.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T01:50:15.615 INFO:tasks.ceph.mds.b.smithi139.stdout:starting mds.b at 2024-09-21T01:50:15.615 INFO:tasks.ceph.mds.d.smithi139.stdout:starting mds.d at 2024-09-21T01:50:15.618 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-09-21T01:50:15.619 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-09-21T01:50:15.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.657+0000 7f94d9627640 1 -- 172.21.15.40:0/4212848147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40d12c0 msgr2=0x7f94d40d16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:15.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.657+0000 7f94d9627640 1 --2- 172.21.15.40:0/4212848147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40d12c0 0x7f94d40d16d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f94d40724e0 tx=0x7f94cc02aac0 comp rx=0 tx=0).stop 2024-09-21T01:50:15.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.657+0000 7f94d9627640 1 -- 172.21.15.40:0/4212848147 shutdown_connections 2024-09-21T01:50:15.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.657+0000 7f94d9627640 1 --2- 172.21.15.40:0/4212848147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40d12c0 0x7f94d40d16d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:15.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.657+0000 7f94d9627640 1 --2- 172.21.15.40:0/4212848147 >> v2:172.21.15.139:3300/0 conn(0x7f94d40ccbd0 0x7f94d40d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:15.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.657+0000 7f94d9627640 1 -- 172.21.15.40:0/4212848147 >> 172.21.15.40:0/4212848147 conn(0x7f94d4072ae0 msgr2=0x7f94d4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:15.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.657+0000 7f94d9627640 1 -- 172.21.15.40:0/4212848147 shutdown_connections 2024-09-21T01:50:15.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.657+0000 7f94d9627640 1 -- 172.21.15.40:0/4212848147 wait complete. 2024-09-21T01:50:15.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.659+0000 7f94d9627640 1 Processor -- start 2024-09-21T01:50:15.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.659+0000 7f94d9627640 1 -- start start 2024-09-21T01:50:15.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.660+0000 7f94d9627640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40b51c0 0x7f94d40c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:15.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.660+0000 7f94d9627640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d40ccbd0 0x7f94d41526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:15.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.660+0000 7f94d9627640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d40d12c0 0x7f94d40a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.660+0000 7f94d9627640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f94d40cf280 con 0x7f94d40b51c0 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.660+0000 7f94d9627640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f94d40cf100 con 0x7f94d40ccbd0 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.660+0000 7f94d9627640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f94d40cf400 con 0x7f94d40d12c0 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40b51c0 0x7f94d40c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40b51c0 0x7f94d40c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33854/0 (socket says 172.21.15.40:33854) 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d2ffd640 1 -- 172.21.15.40:0/2589581250 learned_addr learned my addr 172.21.15.40:0/2589581250 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d27fc640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d40ccbd0 0x7f94d41526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d37fe640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d40d12c0 0x7f94d40a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d2ffd640 1 -- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d40d12c0 msgr2=0x7f94d40a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d2ffd640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d40d12c0 0x7f94d40a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d2ffd640 1 -- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d40ccbd0 msgr2=0x7f94d41526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:15.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d2ffd640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d40ccbd0 0x7f94d41526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d2ffd640 1 -- 172.21.15.40:0/2589581250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d40c9250 con 0x7f94d40b51c0 2024-09-21T01:50:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d2ffd640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40b51c0 0x7f94d40c8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c3a0 tx=0x7f94bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94cb7fe640 1 -- 172.21.15.40:0/2589581250 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc017070 con 0x7f94d40b51c0 2024-09-21T01:50:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94cb7fe640 1 -- 172.21.15.40:0/2589581250 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94bc0053c0 con 0x7f94d40b51c0 2024-09-21T01:50:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94cb7fe640 1 -- 172.21.15.40:0/2589581250 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc003850 con 0x7f94d40b51c0 2024-09-21T01:50:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d40c9530 con 0x7f94d40b51c0 2024-09-21T01:50:15.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.661+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d40ca970 con 0x7f94d40b51c0 2024-09-21T01:50:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.662+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d40cf8b0 con 0x7f94d40b51c0 2024-09-21T01:50:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.663+0000 7f94cb7fe640 1 -- 172.21.15.40:0/2589581250 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f94bc01a070 con 0x7f94d40b51c0 2024-09-21T01:50:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.664+0000 7f94cb7fe640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f94b4078bc0 0x7f94b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.664+0000 7f94cb7fe640 1 -- 172.21.15.40:0/2589581250 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f94bc099dc0 con 0x7f94d40b51c0 2024-09-21T01:50:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.664+0000 7f94d27fc640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f94b4078bc0 0x7f94b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:15.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.664+0000 7f94d27fc640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f94b4078bc0 0x7f94b407b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f94d40b3070 tx=0x7f94c4005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:15.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.668+0000 7f94cb7fe640 1 -- 172.21.15.40:0/2589581250 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f94bc061e20 con 0x7f94d40b51c0 2024-09-21T01:50:15.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:15.872+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f94d40b3660 con 0x7f94d40b51c0 2024-09-21T01:50:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.453+0000 7f94cb7fe640 1 -- 172.21.15.40:0/2589581250 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f94bc066850 con 0x7f94d40b51c0 2024-09-21T01:50:16.454 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f94b4078bc0 msgr2=0x7f94b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f94b4078bc0 0x7f94b407b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f94d40b3070 tx=0x7f94c4005f90 comp rx=0 tx=0).stop 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40b51c0 msgr2=0x7f94d40c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40b51c0 0x7f94d40c8a20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c3a0 tx=0x7f94bc00c860 comp rx=0 tx=0).stop 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 shutdown_connections 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f94b4078bc0 0x7f94b407b0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94d40d12c0 0x7f94d40a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d40ccbd0 0x7f94d41526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 --2- 172.21.15.40:0/2589581250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94d40b51c0 0x7f94d40c8a20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 >> 172.21.15.40:0/2589581250 conn(0x7f94d4072ae0 msgr2=0x7f94d415e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 shutdown_connections 2024-09-21T01:50:16.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.456+0000 7f94d9627640 1 -- 172.21.15.40:0/2589581250 wait complete. 2024-09-21T01:50:16.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T01:50:16.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.589+0000 7f88483a1640 1 -- 172.21.15.40:0/880374932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400b5fa0 msgr2=0x7f88400b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:16.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.589+0000 7f88483a1640 1 --2- 172.21.15.40:0/880374932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400b5fa0 0x7f88400b63b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f88400ceb00 tx=0x7f883002a570 comp rx=0 tx=0).stop 2024-09-21T01:50:16.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.589+0000 7f88483a1640 1 -- 172.21.15.40:0/880374932 shutdown_connections 2024-09-21T01:50:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.589+0000 7f88483a1640 1 --2- 172.21.15.40:0/880374932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400b5fa0 0x7f88400b63b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.589+0000 7f88483a1640 1 --2- 172.21.15.40:0/880374932 >> v2:172.21.15.139:3300/0 conn(0x7f88400ced80 0x7f88400cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.589+0000 7f88483a1640 1 --2- 172.21.15.40:0/880374932 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f88400b9970 0x7f88400b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.589+0000 7f88483a1640 1 -- 172.21.15.40:0/880374932 >> 172.21.15.40:0/880374932 conn(0x7f884009d7f0 msgr2=0x7f88400d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.589+0000 7f88483a1640 1 -- 172.21.15.40:0/880374932 shutdown_connections 2024-09-21T01:50:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.589+0000 7f88483a1640 1 -- 172.21.15.40:0/880374932 wait complete. 2024-09-21T01:50:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.591+0000 7f88483a1640 1 Processor -- start 2024-09-21T01:50:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.591+0000 7f88483a1640 1 -- start start 2024-09-21T01:50:16.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.592+0000 7f88483a1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88400b5fa0 0x7f88400cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:16.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.592+0000 7f88483a1640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f88400b9970 0x7f88400c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:16.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.592+0000 7f88483a1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400ced80 0x7f88400c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:16.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.592+0000 7f88483a1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f88400cf850 con 0x7f88400ced80 2024-09-21T01:50:16.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.592+0000 7f88483a1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f88400cf6d0 con 0x7f88400b5fa0 2024-09-21T01:50:16.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.592+0000 7f88483a1640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f88400cf9d0 con 0x7f88400b9970 2024-09-21T01:50:16.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.592+0000 7f884693e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400ced80 0x7f88400c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.592+0000 7f884693e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400ced80 0x7f88400c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33874/0 (socket says 172.21.15.40:33874) 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f884693e640 1 -- 172.21.15.40:0/3465311043 learned_addr learned my addr 172.21.15.40:0/3465311043 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f884593c640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f88400b9970 0x7f88400c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f884613d640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88400b5fa0 0x7f88400cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f884693e640 1 -- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f88400b9970 msgr2=0x7f88400c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f884693e640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f88400b9970 0x7f88400c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f884693e640 1 -- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88400b5fa0 msgr2=0x7f88400cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f884693e640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88400b5fa0 0x7f88400cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f884693e640 1 -- 172.21.15.40:0/3465311043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88400c9e20 con 0x7f88400ced80 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f884693e640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400ced80 0x7f88400c9790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f883800d660 tx=0x7f883800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f8836ffd640 1 -- 172.21.15.40:0/3465311043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838017070 con 0x7f88400ced80 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f8836ffd640 1 -- 172.21.15.40:0/3465311043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8838004310 con 0x7f88400ced80 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f8836ffd640 1 -- 172.21.15.40:0/3465311043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838005280 con 0x7f88400ced80 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88400ca100 con 0x7f88400ced80 2024-09-21T01:50:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.593+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88400ca6c0 con 0x7f88400ced80 2024-09-21T01:50:16.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.594+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88400cfe80 con 0x7f88400ced80 2024-09-21T01:50:16.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.595+0000 7f8836ffd640 1 -- 172.21.15.40:0/3465311043 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8838005420 con 0x7f88400ced80 2024-09-21T01:50:16.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.596+0000 7f8836ffd640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8824078b90 0x7f882407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:16.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.596+0000 7f8836ffd640 1 -- 172.21.15.40:0/3465311043 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f883809abf0 con 0x7f88400ced80 2024-09-21T01:50:16.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.596+0000 7f884613d640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8824078b90 0x7f882407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:16.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.596+0000 7f884613d640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8824078b90 0x7f882407b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f883c005fd0 tx=0x7f883c0094a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:16.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.601+0000 7f8836ffd640 1 -- 172.21.15.40:0/3465311043 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8838020020 con 0x7f88400ced80 2024-09-21T01:50:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.864+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8840160730 con 0x7f88400ced80 2024-09-21T01:50:16.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.865+0000 7f8836ffd640 1 -- 172.21.15.40:0/3465311043 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f8838062dc0 con 0x7f88400ced80 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD2Je5mqGs1KxAAkvWSbpIqAd7AXhyqa6sRUA==", 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.866 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD2Je5mHjZIOBAApQwg1vayW8v1Qd0vEkx5HQ==", 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.867 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD2Je5mR2n8MhAAhRVm6iATASitlsJT0zjwdQ==", 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD3Je5miEBEBBAAEGWdgX4GQ83t2eaLvAgAaA==", 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-21T01:50:16.868 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD6Je5mqSKqIRAAHo4PFE6LadGp0bufxsoUvQ==", 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.869 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD9Je5mDkmgJBAAxOJ/AnIH1KmM0/dJueNEIA==", 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAAJu5m0TUfNhAAb0viIbYtQuPh3Bj2xcHJiA==", 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.870 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAEJu5mlaBRCxAAXvhbOBydBeeV7PXW5tS83w==", 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAKJu5mWb8EFhAA51gDu+3LHLLONS4rureOlA==", 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQANJu5mxNMqNxAAtjwzkDVlb32k+oPD5wawtg==", 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-21T01:50:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQARJu5mQ68cDRAA4V1HqPU7fszWYt/HXPuJaw==", 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2024-09-21T01:50:16.873 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAUJu5mZT7rDxAAMESWJUIGIcvbJv+bdZH8yw==", 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD3Je5mKd0UCRAATv+wqTRVwprFAiJ5ouQBFA==", 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-09-21T01:50:16.874 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD3Je5mN/jAEBAAKYlD6v4iOxgvE5/2BmiAtA==", 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.875 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD3Je5moq3tDBAAaQ1F3LWs87oqZm3Hz8eCIA==", 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD3Je5mV4t8FBAA/2Nwj01ql2Hq2DJxnXk6Sg==", 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-09-21T01:50:16.876 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA==", 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.877 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mds", 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAaJu5mbcmMNRAAfLeXzkb2/Qzy/wIko64+sw==", 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mds" 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mgr", 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAaJu5mpNOMNRAAmxcIGxUiBdkBUFxKbGAPVg==", 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-21T01:50:16.878 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-osd", 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAaJu5mYduMNRAAFFSRFFvxzmwRDs53QiRh+w==", 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-osd" 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd", 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAaJu5mDeOMNRAAq7R5Diw8O14iDpCk/4+02A==", 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.879 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAaJu5mx+6MNRAAo9UH4OmZULWiS94goBqkFA==", 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rgw", 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAaJu5mPfeMNRAAY/F3AbhJd+lTERlIl7yd5g==", 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.880 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD2Je5mw5NPJxAAnjFuL9hJP+q+jQaRguIZMQ==", 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD2Je5mc6dMIxAADRPrch7v0yVGrByQCNrhvw==", 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-09-21T01:50:16.881 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2024-09-21T01:50:16.882 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2024-09-21T01:50:16.882 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-09-21T01:50:16.882 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.882 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:16.882 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-09-21T01:50:16.882 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-21T01:50:16.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8824078b90 msgr2=0x7f882407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:16.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8824078b90 0x7f882407b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f883c005fd0 tx=0x7f883c0094a0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400ced80 msgr2=0x7f88400c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400ced80 0x7f88400c9790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f883800d660 tx=0x7f883800db20 comp rx=0 tx=0).stop 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 shutdown_connections 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8824078b90 0x7f882407b0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88400ced80 0x7f88400c9790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f88400b9970 0x7f88400c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 --2- 172.21.15.40:0/3465311043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f88400b5fa0 0x7f88400cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 >> 172.21.15.40:0/3465311043 conn(0x7f884009d7f0 msgr2=0x7f884015ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 shutdown_connections 2024-09-21T01:50:16.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:16.867+0000 7f88483a1640 1 -- 172.21.15.40:0/3465311043 wait complete. 2024-09-21T01:50:16.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-21T01:50:17.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.001+0000 7fa155669640 1 -- 172.21.15.40:0/1605889280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006e170 msgr2=0x7fa1500b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.001+0000 7fa155669640 1 --2- 172.21.15.40:0/1605889280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006e170 0x7fa1500b3540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa148009900 tx=0x7fa14802a580 comp rx=0 tx=0).stop 2024-09-21T01:50:17.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.001+0000 7fa155669640 1 -- 172.21.15.40:0/1605889280 shutdown_connections 2024-09-21T01:50:17.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.001+0000 7fa155669640 1 --2- 172.21.15.40:0/1605889280 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1500ceb40 0x7fa1500cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.001+0000 7fa155669640 1 --2- 172.21.15.40:0/1605889280 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006e170 0x7fa1500b3540 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.001+0000 7fa155669640 1 -- 172.21.15.40:0/1605889280 >> 172.21.15.40:0/1605889280 conn(0x7fa15008bfc0 msgr2=0x7fa15009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.001+0000 7fa155669640 1 -- 172.21.15.40:0/1605889280 shutdown_connections 2024-09-21T01:50:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.001+0000 7fa155669640 1 -- 172.21.15.40:0/1605889280 wait complete. 2024-09-21T01:50:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.003+0000 7fa155669640 1 Processor -- start 2024-09-21T01:50:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.003+0000 7fa155669640 1 -- start start 2024-09-21T01:50:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.004+0000 7fa155669640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f4b0 0x7fa1500a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.004+0000 7fa155669640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1500ceb40 0x7fa1500b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.004+0000 7fa155669640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1500b2110 0x7fa1500cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.004+0000 7fa155669640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1500d0e60 con 0x7fa15006f4b0 2024-09-21T01:50:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.004+0000 7fa155669640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa1500d0ce0 con 0x7fa1500b2110 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.004+0000 7fa155669640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fa1500d0fe0 con 0x7fa1500ceb40 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.004+0000 7fa14effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f4b0 0x7fa1500a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.004+0000 7fa14effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f4b0 0x7fa1500a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33902/0 (socket says 172.21.15.40:33902) 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.004+0000 7fa14effd640 1 -- 172.21.15.40:0/2197953876 learned_addr learned my addr 172.21.15.40:0/2197953876 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa14f7fe640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1500b2110 0x7fa1500cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa14e7fc640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1500ceb40 0x7fa1500b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa14effd640 1 -- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1500ceb40 msgr2=0x7fa1500b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa14effd640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1500ceb40 0x7fa1500b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa14effd640 1 -- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1500b2110 msgr2=0x7fa1500cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa14effd640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1500b2110 0x7fa1500cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa14effd640 1 -- 172.21.15.40:0/2197953876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1500b2520 con 0x7fa15006f4b0 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa14e7fc640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1500ceb40 0x7fa1500b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa14effd640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f4b0 0x7fa1500a1950 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa148034040 tx=0x7fa148003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa1477fe640 1 -- 172.21.15.40:0/2197953876 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14803e030 con 0x7fa15006f4b0 2024-09-21T01:50:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa1477fe640 1 -- 172.21.15.40:0/2197953876 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa148003e00 con 0x7fa15006f4b0 2024-09-21T01:50:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1501f4fa0 con 0x7fa15006f4b0 2024-09-21T01:50:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa1477fe640 1 -- 172.21.15.40:0/2197953876 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa148035040 con 0x7fa15006f4b0 2024-09-21T01:50:17.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.005+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1501f54f0 con 0x7fa15006f4b0 2024-09-21T01:50:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.006+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1500d15a0 con 0x7fa15006f4b0 2024-09-21T01:50:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.007+0000 7fa1477fe640 1 -- 172.21.15.40:0/2197953876 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa148041030 con 0x7fa15006f4b0 2024-09-21T01:50:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.007+0000 7fa1477fe640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa130078b90 0x7fa13007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.008+0000 7fa1477fe640 1 -- 172.21.15.40:0/2197953876 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fa1480bb570 con 0x7fa15006f4b0 2024-09-21T01:50:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.008+0000 7fa14e7fc640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa130078b90 0x7fa13007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.008+0000 7fa14e7fc640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa130078b90 0x7fa13007b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa138007fd0 tx=0x7fa138009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:17.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.012+0000 7fa1477fe640 1 -- 172.21.15.40:0/2197953876 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa1500b2520 con 0x7fa15006f4b0 2024-09-21T01:50:17.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.276+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fa1501f5e90 con 0x7fa15006f4b0 2024-09-21T01:50:17.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.279+0000 7fa1477fe640 1 -- 172.21.15.40:0/2197953876 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fa1480836b0 con 0x7fa15006f4b0 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa130078b90 msgr2=0x7fa13007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa130078b90 0x7fa13007b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa138007fd0 tx=0x7fa138009040 comp rx=0 tx=0).stop 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f4b0 msgr2=0x7fa1500a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f4b0 0x7fa1500a1950 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa148034040 tx=0x7fa148003910 comp rx=0 tx=0).stop 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 shutdown_connections 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa130078b90 0x7fa13007b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1500b2110 0x7fa1500cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa1500ceb40 0x7fa1500b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 --2- 172.21.15.40:0/2197953876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa15006f4b0 0x7fa1500a1950 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 >> 172.21.15.40:0/2197953876 conn(0x7fa15008bfc0 msgr2=0x7fa1500b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:17.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 shutdown_connections 2024-09-21T01:50:17.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.281+0000 7fa155669640 1 -- 172.21.15.40:0/2197953876 wait complete. 2024-09-21T01:50:17.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-21T01:50:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.410+0000 7f73c933a640 1 -- 172.21.15.40:0/2231312881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ac003a00 msgr2=0x7f73ac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.410+0000 7f73c933a640 1 --2- 172.21.15.40:0/2231312881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ac003a00 0x7f73ac003e70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009b50 tx=0x7f73ac005830 comp rx=0 tx=0).stop 2024-09-21T01:50:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.410+0000 7f73c37fe640 1 -- 172.21.15.40:0/2231312881 reap_dead start 2024-09-21T01:50:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.410+0000 7f73c933a640 1 -- 172.21.15.40:0/2231312881 shutdown_connections 2024-09-21T01:50:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.410+0000 7f73c933a640 1 -- 172.21.15.40:0/2231312881 >> 172.21.15.40:0/2231312881 conn(0x7f73c40b1cb0 msgr2=0x7f73c40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:17.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.410+0000 7f73c933a640 1 -- 172.21.15.40:0/2231312881 shutdown_connections 2024-09-21T01:50:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.410+0000 7f73c933a640 1 -- 172.21.15.40:0/2231312881 wait complete. 2024-09-21T01:50:17.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.412+0000 7f73c933a640 1 Processor -- start 2024-09-21T01:50:17.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.412+0000 7f73c933a640 1 -- start start 2024-09-21T01:50:17.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.413+0000 7f73c933a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ac003a00 0x7f73c414e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.413+0000 7f73c933a640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f73c409b3d0 0x7f73c40d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.413+0000 7f73c933a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73c40d0730 0x7f73c40c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.413+0000 7f73c933a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f73c415c900 con 0x7f73ac003a00 2024-09-21T01:50:17.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.413+0000 7f73c933a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f73c415c780 con 0x7f73c40d0730 2024-09-21T01:50:17.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.413+0000 7f73c933a640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f73c415ca80 con 0x7f73c409b3d0 2024-09-21T01:50:17.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.413+0000 7f73c2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ac003a00 0x7f73c414e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.413+0000 7f73c2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ac003a00 0x7f73c414e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33924/0 (socket says 172.21.15.40:33924) 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c2ffd640 1 -- 172.21.15.40:0/68403813 learned_addr learned my addr 172.21.15.40:0/68403813 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c37fe640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73c40d0730 0x7f73c40c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c27fc640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f73c409b3d0 0x7f73c40d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c2ffd640 1 -- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f73c409b3d0 msgr2=0x7f73c40d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c2ffd640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f73c409b3d0 0x7f73c40d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c2ffd640 1 -- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73c40d0730 msgr2=0x7f73c40c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c2ffd640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73c40d0730 0x7f73c40c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c2ffd640 1 -- 172.21.15.40:0/68403813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c40d0b40 con 0x7f73ac003a00 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c37fe640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73c40d0730 0x7f73c40c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c2ffd640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ac003a00 0x7f73c414e610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f73b4036040 tx=0x7f73b4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73ab7fe640 1 -- 172.21.15.40:0/68403813 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4038040 con 0x7f73ac003a00 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73ab7fe640 1 -- 172.21.15.40:0/68403813 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73b4004020 con 0x7f73ac003a00 2024-09-21T01:50:17.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c409aff0 con 0x7f73ac003a00 2024-09-21T01:50:17.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73ab7fe640 1 -- 172.21.15.40:0/68403813 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4004470 con 0x7f73ac003a00 2024-09-21T01:50:17.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.414+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c409de80 con 0x7f73ac003a00 2024-09-21T01:50:17.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.415+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c4074640 con 0x7f73ac003a00 2024-09-21T01:50:17.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.416+0000 7f73ab7fe640 1 -- 172.21.15.40:0/68403813 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73b4045020 con 0x7f73ac003a00 2024-09-21T01:50:17.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.417+0000 7f73ab7fe640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f73b0078b90 0x7f73b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.417+0000 7f73ab7fe640 1 -- 172.21.15.40:0/68403813 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f73b40bb3b0 con 0x7f73ac003a00 2024-09-21T01:50:17.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.417+0000 7f73c27fc640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f73b0078b90 0x7f73b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.418+0000 7f73c27fc640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f73b0078b90 0x7f73b007b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f73c40c9a10 tx=0x7f73b8005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:17.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.421+0000 7f73ab7fe640 1 -- 172.21.15.40:0/68403813 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f73c40d0b40 con 0x7f73ac003a00 2024-09-21T01:50:17.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.683+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f73c40c3860 con 0x7f73ac003a00 2024-09-21T01:50:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.687+0000 7f73ab7fe640 1 -- 172.21.15.40:0/68403813 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f73b4083be0 con 0x7f73ac003a00 2024-09-21T01:50:17.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f73b0078b90 msgr2=0x7f73b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f73b0078b90 0x7f73b007b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f73c40c9a10 tx=0x7f73b8005f90 comp rx=0 tx=0).stop 2024-09-21T01:50:17.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ac003a00 msgr2=0x7f73c414e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ac003a00 0x7f73c414e610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f73b4036040 tx=0x7f73b4033670 comp rx=0 tx=0).stop 2024-09-21T01:50:17.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 shutdown_connections 2024-09-21T01:50:17.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f73b0078b90 0x7f73b007b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73c40d0730 0x7f73c40c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f73c409b3d0 0x7f73c40d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 --2- 172.21.15.40:0/68403813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f73ac003a00 0x7f73c414e610 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 >> 172.21.15.40:0/68403813 conn(0x7f73c40b1cb0 msgr2=0x7f73c415ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 shutdown_connections 2024-09-21T01:50:17.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.689+0000 7f73c933a640 1 -- 172.21.15.40:0/68403813 wait complete. 2024-09-21T01:50:17.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-21T01:50:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.817+0000 7f3fc8171640 1 -- 172.21.15.40:0/3743099670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00b5210 msgr2=0x7f3fc00ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.817+0000 7f3fc8171640 1 --2- 172.21.15.40:0/3743099670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00b5210 0x7f3fc00ceb50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009830 tx=0x7f3fb402a510 comp rx=0 tx=0).stop 2024-09-21T01:50:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.817+0000 7f3fc8171640 1 -- 172.21.15.40:0/3743099670 shutdown_connections 2024-09-21T01:50:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.817+0000 7f3fc8171640 1 --2- 172.21.15.40:0/3743099670 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fc00ccba0 0x7f3fc00ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.817+0000 7f3fc8171640 1 --2- 172.21.15.40:0/3743099670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00b5210 0x7f3fc00ceb50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.817+0000 7f3fc8171640 1 -- 172.21.15.40:0/3743099670 >> 172.21.15.40:0/3743099670 conn(0x7f3fc00b3f10 msgr2=0x7f3fc00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.817+0000 7f3fc8171640 1 -- 172.21.15.40:0/3743099670 shutdown_connections 2024-09-21T01:50:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.817+0000 7f3fc8171640 1 -- 172.21.15.40:0/3743099670 wait complete. 2024-09-21T01:50:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.819+0000 7f3fc8171640 1 Processor -- start 2024-09-21T01:50:17.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.819+0000 7f3fc8171640 1 -- start start 2024-09-21T01:50:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.820+0000 7f3fc8171640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fc00b5210 0x7f3fc01582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.820+0000 7f3fc8171640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00ccba0 0x7f3fc01f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.820+0000 7f3fc8171640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fc00d1d40 0x7f3fc01f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.820+0000 7f3fc8171640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc00d11f0 con 0x7f3fc00ccba0 2024-09-21T01:50:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.820+0000 7f3fc8171640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc00d1070 con 0x7f3fc00d1d40 2024-09-21T01:50:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.820+0000 7f3fc8171640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc00d1370 con 0x7f3fc00b5210 2024-09-21T01:50:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.820+0000 7f3fc570c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00ccba0 0x7f3fc01f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.820+0000 7f3fc570c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00ccba0 0x7f3fc01f7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33942/0 (socket says 172.21.15.40:33942) 2024-09-21T01:50:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.820+0000 7f3fc570c640 1 -- 172.21.15.40:0/4179004376 learned_addr learned my addr 172.21.15.40:0/4179004376 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc5f0d640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fc00b5210 0x7f3fc01582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc670e640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fc00d1d40 0x7f3fc01f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc570c640 1 -- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fc00b5210 msgr2=0x7f3fc01582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc570c640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fc00b5210 0x7f3fc01582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc570c640 1 -- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fc00d1d40 msgr2=0x7f3fc01f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc570c640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fc00d1d40 0x7f3fc01f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc570c640 1 -- 172.21.15.40:0/4179004376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc0159490 con 0x7f3fc00ccba0 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc570c640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00ccba0 0x7f3fc01f7360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009950 tx=0x7f3fb4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fbe7fc640 1 -- 172.21.15.40:0/4179004376 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4031d60 con 0x7f3fc00ccba0 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fbe7fc640 1 -- 172.21.15.40:0/4179004376 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fb4033e10 con 0x7f3fc00ccba0 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc0159770 con 0x7f3fc00ccba0 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fbe7fc640 1 -- 172.21.15.40:0/4179004376 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4005260 con 0x7f3fc00ccba0 2024-09-21T01:50:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.821+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc01f3780 con 0x7f3fc00ccba0 2024-09-21T01:50:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.822+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc00d18b0 con 0x7f3fc00ccba0 2024-09-21T01:50:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.823+0000 7f3fbe7fc640 1 -- 172.21.15.40:0/4179004376 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fb4005400 con 0x7f3fc00ccba0 2024-09-21T01:50:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.823+0000 7f3fbe7fc640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3fac078b90 0x7f3fac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.824+0000 7f3fbe7fc640 1 -- 172.21.15.40:0/4179004376 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f3fb40bbc30 con 0x7f3fc00ccba0 2024-09-21T01:50:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.824+0000 7f3fc5f0d640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3fac078b90 0x7f3fac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.824+0000 7f3fc5f0d640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3fac078b90 0x7f3fac07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00012e0 tx=0x7f3fb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:17.828+0000 7f3fbe7fc640 1 -- 172.21.15.40:0/4179004376 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3fb403f030 con 0x7f3fc00ccba0 2024-09-21T01:50:18.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.089+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f3fc015b370 con 0x7f3fc00ccba0 2024-09-21T01:50:18.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.092+0000 7f3fbe7fc640 1 -- 172.21.15.40:0/4179004376 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f3fb4083d80 con 0x7f3fc00ccba0 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3fac078b90 msgr2=0x7f3fac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3fac078b90 0x7f3fac07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00012e0 tx=0x7f3fb0009040 comp rx=0 tx=0).stop 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00ccba0 msgr2=0x7f3fc01f7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00ccba0 0x7f3fc01f7360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009950 tx=0x7f3fb4033c20 comp rx=0 tx=0).stop 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 shutdown_connections 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f3fac078b90 0x7f3fac07b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3fc00d1d40 0x7f3fc01f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc00ccba0 0x7f3fc01f7360 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 --2- 172.21.15.40:0/4179004376 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f3fc00b5210 0x7f3fc01582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 >> 172.21.15.40:0/4179004376 conn(0x7f3fc00b3f10 msgr2=0x7f3fc015a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 shutdown_connections 2024-09-21T01:50:18.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.094+0000 7f3fc8171640 1 -- 172.21.15.40:0/4179004376 wait complete. 2024-09-21T01:50:18.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-21T01:50:18.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.223+0000 7fac778ce640 1 -- 172.21.15.40:0/1507792424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac700ceb40 msgr2=0x7fac700cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.223+0000 7fac778ce640 1 --2- 172.21.15.40:0/1507792424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac700ceb40 0x7fac700cef50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fac68005fd0 tx=0x7fac6802a820 comp rx=0 tx=0).stop 2024-09-21T01:50:18.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.223+0000 7fac778ce640 1 -- 172.21.15.40:0/1507792424 shutdown_connections 2024-09-21T01:50:18.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.223+0000 7fac778ce640 1 --2- 172.21.15.40:0/1507792424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac700ceb40 0x7fac700cef50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.223+0000 7fac778ce640 1 --2- 172.21.15.40:0/1507792424 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac7006e170 0x7fac700b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.223+0000 7fac778ce640 1 -- 172.21.15.40:0/1507792424 >> 172.21.15.40:0/1507792424 conn(0x7fac7008bfc0 msgr2=0x7fac7009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:18.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.223+0000 7fac778ce640 1 -- 172.21.15.40:0/1507792424 shutdown_connections 2024-09-21T01:50:18.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.223+0000 7fac778ce640 1 -- 172.21.15.40:0/1507792424 wait complete. 2024-09-21T01:50:18.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.225+0000 7fac778ce640 1 Processor -- start 2024-09-21T01:50:18.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.225+0000 7fac778ce640 1 -- start start 2024-09-21T01:50:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac778ce640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac7006f4b0 0x7fac7015fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac778ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac700ceb40 0x7fac700cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac778ce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac700cca90 0x7fac701f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac778ce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fac700d0e60 con 0x7fac700cca90 2024-09-21T01:50:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac778ce640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fac700d0ce0 con 0x7fac700ceb40 2024-09-21T01:50:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac778ce640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fac700d0fe0 con 0x7fac7006f4b0 2024-09-21T01:50:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac75e6b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac700cca90 0x7fac701f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac75e6b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac700cca90 0x7fac701f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33950/0 (socket says 172.21.15.40:33950) 2024-09-21T01:50:18.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac75e6b640 1 -- 172.21.15.40:0/3878609352 learned_addr learned my addr 172.21.15.40:0/3878609352 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac7566a640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac7006f4b0 0x7fac7015fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac74e69640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac700ceb40 0x7fac700cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac75e6b640 1 -- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac7006f4b0 msgr2=0x7fac7015fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac75e6b640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac7006f4b0 0x7fac7015fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac75e6b640 1 -- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac700ceb40 msgr2=0x7fac700cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac75e6b640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac700ceb40 0x7fac700cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.226+0000 7fac75e6b640 1 -- 172.21.15.40:0/3878609352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7009e1d0 con 0x7fac700cca90 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.227+0000 7fac75e6b640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac700cca90 0x7fac701f5170 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac68009b30 tx=0x7fac68032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.227+0000 7fac65ffb640 1 -- 172.21.15.40:0/3878609352 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68037040 con 0x7fac700cca90 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.227+0000 7fac65ffb640 1 -- 172.21.15.40:0/3878609352 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac68042070 con 0x7fac700cca90 2024-09-21T01:50:18.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.227+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac700ce710 con 0x7fac700cca90 2024-09-21T01:50:18.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.227+0000 7fac65ffb640 1 -- 172.21.15.40:0/3878609352 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac680042a0 con 0x7fac700cca90 2024-09-21T01:50:18.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.227+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac700cbd50 con 0x7fac700cca90 2024-09-21T01:50:18.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.228+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac700d14b0 con 0x7fac700cca90 2024-09-21T01:50:18.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.229+0000 7fac65ffb640 1 -- 172.21.15.40:0/3878609352 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fac68004440 con 0x7fac700cca90 2024-09-21T01:50:18.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.229+0000 7fac65ffb640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac54078b90 0x7fac5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:18.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.229+0000 7fac65ffb640 1 -- 172.21.15.40:0/3878609352 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fac680bb6c0 con 0x7fac700cca90 2024-09-21T01:50:18.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.230+0000 7fac7566a640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac54078b90 0x7fac5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:18.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.230+0000 7fac7566a640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac54078b90 0x7fac5407b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0095f0 tx=0x7fac6c005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:18.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.234+0000 7fac65ffb640 1 -- 172.21.15.40:0/3878609352 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fac68083770 con 0x7fac700cca90 2024-09-21T01:50:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.497+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fac700ce4a0 con 0x7fac700cca90 2024-09-21T01:50:18.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.500+0000 7fac65ffb640 1 -- 172.21.15.40:0/3878609352 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fac680881a0 con 0x7fac700cca90 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac54078b90 msgr2=0x7fac5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac54078b90 0x7fac5407b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0095f0 tx=0x7fac6c005f90 comp rx=0 tx=0).stop 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac700cca90 msgr2=0x7fac701f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac700cca90 0x7fac701f5170 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac68009b30 tx=0x7fac68032c90 comp rx=0 tx=0).stop 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 shutdown_connections 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fac54078b90 0x7fac5407b0a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac700cca90 0x7fac701f5170 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fac700ceb40 0x7fac700cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 --2- 172.21.15.40:0/3878609352 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fac7006f4b0 0x7fac7015fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 >> 172.21.15.40:0/3878609352 conn(0x7fac7008bfc0 msgr2=0x7fac700b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 shutdown_connections 2024-09-21T01:50:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.502+0000 7fac778ce640 1 -- 172.21.15.40:0/3878609352 wait complete. 2024-09-21T01:50:18.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-21T01:50:18.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.630+0000 7fbfd0769640 1 -- 172.21.15.40:0/1957861810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc80b9d00 msgr2=0x7fbfc80cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.630+0000 7fbfd0769640 1 --2- 172.21.15.40:0/1957861810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc80b9d00 0x7fbfc80cfb40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80d4450 tx=0x7fbfc402a530 comp rx=0 tx=0).stop 2024-09-21T01:50:18.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.631+0000 7fbfd0769640 1 -- 172.21.15.40:0/1957861810 shutdown_connections 2024-09-21T01:50:18.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.631+0000 7fbfd0769640 1 --2- 172.21.15.40:0/1957861810 >> v2:172.21.15.139:3300/0 conn(0x7fbfc80b66b0 0x7fbfc80d3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.631+0000 7fbfd0769640 1 --2- 172.21.15.40:0/1957861810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc80b9d00 0x7fbfc80cfb40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.631+0000 7fbfd0769640 1 -- 172.21.15.40:0/1957861810 >> 172.21.15.40:0/1957861810 conn(0x7fbfc809d870 msgr2=0x7fbfc80d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:18.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.631+0000 7fbfd0769640 1 -- 172.21.15.40:0/1957861810 shutdown_connections 2024-09-21T01:50:18.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.631+0000 7fbfd0769640 1 -- 172.21.15.40:0/1957861810 wait complete. 2024-09-21T01:50:18.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.632+0000 7fbfd0769640 1 Processor -- start 2024-09-21T01:50:18.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.632+0000 7fbfd0769640 1 -- start start 2024-09-21T01:50:18.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfd0769640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfc80b9d00 0x7fbfc81f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfd0769640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc81620e0 0x7fbfc80c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfd0769640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfc815ddc0 0x7fbfc81f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfd0769640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc806e3a0 con 0x7fbfc81620e0 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfd0769640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc806e220 con 0x7fbfc80b9d00 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfd0769640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc806e520 con 0x7fbfc815ddc0 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfcdd04640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc81620e0 0x7fbfc80c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfcdd04640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc81620e0 0x7fbfc80c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33964/0 (socket says 172.21.15.40:33964) 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfcdd04640 1 -- 172.21.15.40:0/2582022046 learned_addr learned my addr 172.21.15.40:0/2582022046 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfced06640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfc815ddc0 0x7fbfc81f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:18.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfce505640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfc80b9d00 0x7fbfc81f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfcdd04640 1 -- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfc815ddc0 msgr2=0x7fbfc81f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfcdd04640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfc815ddc0 0x7fbfc81f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfcdd04640 1 -- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfc80b9d00 msgr2=0x7fbfc81f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfcdd04640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfc80b9d00 0x7fbfc81f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfcdd04640 1 -- 172.21.15.40:0/2582022046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc80ce450 con 0x7fbfc81620e0 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfcdd04640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc81620e0 0x7fbfc80c91f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800c430 tx=0x7fbfb800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.634+0000 7fbfbeffd640 1 -- 172.21.15.40:0/2582022046 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8011790 con 0x7fbfc81620e0 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.635+0000 7fbfbeffd640 1 -- 172.21.15.40:0/2582022046 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfb8017070 con 0x7fbfc81620e0 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.635+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc80ce730 con 0x7fbfc81620e0 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.635+0000 7fbfbeffd640 1 -- 172.21.15.40:0/2582022046 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8011ca0 con 0x7fbfc81620e0 2024-09-21T01:50:18.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.635+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc81f87d0 con 0x7fbfc81620e0 2024-09-21T01:50:18.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.635+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc806f200 con 0x7fbfc81620e0 2024-09-21T01:50:18.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.636+0000 7fbfbeffd640 1 -- 172.21.15.40:0/2582022046 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbfb801c460 con 0x7fbfc81620e0 2024-09-21T01:50:18.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.637+0000 7fbfbeffd640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fbfac078b90 0x7fbfac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.637+0000 7fbfbeffd640 1 -- 172.21.15.40:0/2582022046 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fbfb809a850 con 0x7fbfc81620e0 2024-09-21T01:50:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.637+0000 7fbfce505640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fbfac078b90 0x7fbfac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:18.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.638+0000 7fbfce505640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fbfac078b90 0x7fbfac07b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4034000 tx=0x7fbfc4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:18.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.641+0000 7fbfbeffd640 1 -- 172.21.15.40:0/2582022046 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbfb8062fe0 con 0x7fbfc81620e0 2024-09-21T01:50:18.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.902+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fbfc80ce1e0 con 0x7fbfc81620e0 2024-09-21T01:50:18.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.905+0000 7fbfbeffd640 1 -- 172.21.15.40:0/2582022046 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7fbfb80628e0 con 0x7fbfc81620e0 2024-09-21T01:50:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fbfac078b90 msgr2=0x7fbfac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fbfac078b90 0x7fbfac07b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4034000 tx=0x7fbfc4004730 comp rx=0 tx=0).stop 2024-09-21T01:50:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc81620e0 msgr2=0x7fbfc80c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc81620e0 0x7fbfc80c91f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800c430 tx=0x7fbfb800c8f0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 shutdown_connections 2024-09-21T01:50:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fbfac078b90 0x7fbfac07b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fbfc815ddc0 0x7fbfc81f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfc81620e0 0x7fbfc80c91f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 --2- 172.21.15.40:0/2582022046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbfc80b9d00 0x7fbfc81f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:18.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 >> 172.21.15.40:0/2582022046 conn(0x7fbfc809d870 msgr2=0x7fbfc80d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:18.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 shutdown_connections 2024-09-21T01:50:18.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:18.907+0000 7fbfd0769640 1 -- 172.21.15.40:0/2582022046 wait complete. 2024-09-21T01:50:18.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-21T01:50:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.036+0000 7fc500132640 1 -- 172.21.15.40:0/4070968112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4e0004800 msgr2=0x7fc4e0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.036+0000 7fc500132640 1 --2- 172.21.15.40:0/4070968112 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4e0004800 0x7fc4e0004c10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8074970 tx=0x7fc4e0005830 comp rx=0 tx=0).stop 2024-09-21T01:50:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.036+0000 7fc4fe6cf640 1 -- 172.21.15.40:0/4070968112 reap_dead start 2024-09-21T01:50:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.036+0000 7fc500132640 1 -- 172.21.15.40:0/4070968112 shutdown_connections 2024-09-21T01:50:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.036+0000 7fc500132640 1 -- 172.21.15.40:0/4070968112 >> 172.21.15.40:0/4070968112 conn(0x7fc4f80d12a0 msgr2=0x7fc4f80d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.036+0000 7fc500132640 1 -- 172.21.15.40:0/4070968112 shutdown_connections 2024-09-21T01:50:19.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.036+0000 7fc500132640 1 -- 172.21.15.40:0/4070968112 wait complete. 2024-09-21T01:50:19.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.038+0000 7fc500132640 1 Processor -- start 2024-09-21T01:50:19.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.038+0000 7fc500132640 1 -- start start 2024-09-21T01:50:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.039+0000 7fc500132640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e0004800 0x7fc4f8071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.039+0000 7fc500132640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4f80b0e10 0x7fc4f80c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.039+0000 7fc500132640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f80b0200 0x7fc4f80b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.039+0000 7fc500132640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f80b4270 con 0x7fc4f80b0200 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.039+0000 7fc500132640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f80b40f0 con 0x7fc4e0004800 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.039+0000 7fc500132640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f80b43f0 con 0x7fc4f80b0e10 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.039+0000 7fc4fe6cf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f80b0200 0x7fc4f80b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.039+0000 7fc4fe6cf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f80b0200 0x7fc4f80b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33982/0 (socket says 172.21.15.40:33982) 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fe6cf640 1 -- 172.21.15.40:0/3011320701 learned_addr learned my addr 172.21.15.40:0/3011320701 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fdece640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e0004800 0x7fc4f8071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fd6cd640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4f80b0e10 0x7fc4f80c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fe6cf640 1 -- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4f80b0e10 msgr2=0x7fc4f80c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fe6cf640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4f80b0e10 0x7fc4f80c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fe6cf640 1 -- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e0004800 msgr2=0x7fc4f8071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fe6cf640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e0004800 0x7fc4f8071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fe6cf640 1 -- 172.21.15.40:0/3011320701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f80b0b50 con 0x7fc4f80b0200 2024-09-21T01:50:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fd6cd640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4f80b0e10 0x7fc4f80c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4fe6cf640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f80b0200 0x7fc4f80b0610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8005fd0 tx=0x7fc4e800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4f67fc640 1 -- 172.21.15.40:0/3011320701 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8004b20 con 0x7fc4f80b0200 2024-09-21T01:50:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4f67fc640 1 -- 172.21.15.40:0/3011320701 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4e8004cc0 con 0x7fc4f80b0200 2024-09-21T01:50:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc4f67fc640 1 -- 172.21.15.40:0/3011320701 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8003bd0 con 0x7fc4f80b0200 2024-09-21T01:50:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f81f2df0 con 0x7fc4f80b0200 2024-09-21T01:50:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.040+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f81f33b0 con 0x7fc4f80b0200 2024-09-21T01:50:19.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.041+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f8071d60 con 0x7fc4f80b0200 2024-09-21T01:50:19.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.042+0000 7fc4f67fc640 1 -- 172.21.15.40:0/3011320701 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc4e8004030 con 0x7fc4f80b0200 2024-09-21T01:50:19.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.043+0000 7fc4f67fc640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc4e4078bc0 0x7fc4e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.043+0000 7fc4f67fc640 1 -- 172.21.15.40:0/3011320701 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fc4e809aea0 con 0x7fc4f80b0200 2024-09-21T01:50:19.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.043+0000 7fc4fdece640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc4e4078bc0 0x7fc4e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.043+0000 7fc4fdece640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc4e4078bc0 0x7fc4e407b0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0000ef0 tx=0x7fc4f0006b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:19.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.047+0000 7fc4f67fc640 1 -- 172.21.15.40:0/3011320701 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc4f80b0b50 con 0x7fc4f80b0200 2024-09-21T01:50:19.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.317+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fc4f806d790 con 0x7fc4f80b0200 2024-09-21T01:50:19.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.320+0000 7fc4f67fc640 1 -- 172.21.15.40:0/3011320701 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7fc4e8063620 con 0x7fc4f80b0200 2024-09-21T01:50:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc4e4078bc0 msgr2=0x7fc4e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc4e4078bc0 0x7fc4e407b0d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0000ef0 tx=0x7fc4f0006b60 comp rx=0 tx=0).stop 2024-09-21T01:50:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f80b0200 msgr2=0x7fc4f80b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f80b0200 0x7fc4f80b0610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8005fd0 tx=0x7fc4e800f3c0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 shutdown_connections 2024-09-21T01:50:19.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fc4e4078bc0 0x7fc4e407b0d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f80b0200 0x7fc4f80b0610 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fc4f80b0e10 0x7fc4f80c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 --2- 172.21.15.40:0/3011320701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc4e0004800 0x7fc4f8071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 >> 172.21.15.40:0/3011320701 conn(0x7fc4f80d12a0 msgr2=0x7fc4f815f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 shutdown_connections 2024-09-21T01:50:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.322+0000 7fc500132640 1 -- 172.21.15.40:0/3011320701 wait complete. 2024-09-21T01:50:19.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T01:50:19.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.450+0000 7f434f798640 1 -- 172.21.15.40:0/1904981111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b9970 msgr2=0x7f43480b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.450+0000 7f434f798640 1 --2- 172.21.15.40:0/1904981111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b9970 0x7f43480b3710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f43480d3de0 tx=0x7f433802a8b0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.450+0000 7f434f798640 1 -- 172.21.15.40:0/1904981111 shutdown_connections 2024-09-21T01:50:19.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.450+0000 7f434f798640 1 --2- 172.21.15.40:0/1904981111 >> v2:172.21.15.139:3300/0 conn(0x7f43480b5fa0 0x7f43480b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.450+0000 7f434f798640 1 --2- 172.21.15.40:0/1904981111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b9970 0x7f43480b3710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.450+0000 7f434f798640 1 -- 172.21.15.40:0/1904981111 >> 172.21.15.40:0/1904981111 conn(0x7f434809d7f0 msgr2=0x7f43480d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:19.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.450+0000 7f434f798640 1 -- 172.21.15.40:0/1904981111 shutdown_connections 2024-09-21T01:50:19.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.450+0000 7f434f798640 1 -- 172.21.15.40:0/1904981111 wait complete. 2024-09-21T01:50:19.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.452+0000 7f434f798640 1 Processor -- start 2024-09-21T01:50:19.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.452+0000 7f434f798640 1 -- start start 2024-09-21T01:50:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.453+0000 7f434f798640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b5fa0 0x7f434815f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.453+0000 7f434f798640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43480b9970 0x7f43480ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.453+0000 7f434f798640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43480ced80 0x7f43480ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.453+0000 7f434f798640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f434806f270 con 0x7f43480b5fa0 2024-09-21T01:50:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.453+0000 7f434f798640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f434806f0f0 con 0x7f43480ced80 2024-09-21T01:50:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.453+0000 7f434f798640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f434806f3f0 con 0x7f43480b9970 2024-09-21T01:50:19.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.453+0000 7f434d534640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b5fa0 0x7f434815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.453+0000 7f434d534640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b5fa0 0x7f434815f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34006/0 (socket says 172.21.15.40:34006) 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.453+0000 7f434d534640 1 -- 172.21.15.40:0/1281090250 learned_addr learned my addr 172.21.15.40:0/1281090250 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434cd33640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43480b9970 0x7f43480ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434dd35640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43480ced80 0x7f43480ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434d534640 1 -- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43480b9970 msgr2=0x7f43480ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434d534640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43480b9970 0x7f43480ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434d534640 1 -- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43480ced80 msgr2=0x7f43480ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434d534640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43480ced80 0x7f43480ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434d534640 1 -- 172.21.15.40:0/1281090250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43480c96d0 con 0x7f43480b5fa0 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434dd35640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43480ced80 0x7f43480ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434d534640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b5fa0 0x7f434815f240 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4338009ca0 tx=0x7f43380042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f4345ffb640 1 -- 172.21.15.40:0/1281090250 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433803f070 con 0x7f43480b5fa0 2024-09-21T01:50:19.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f4345ffb640 1 -- 172.21.15.40:0/1281090250 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4338031440 con 0x7f43480b5fa0 2024-09-21T01:50:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434815d520 con 0x7f43480b5fa0 2024-09-21T01:50:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f4345ffb640 1 -- 172.21.15.40:0/1281090250 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4338031890 con 0x7f43480b5fa0 2024-09-21T01:50:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.454+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434815dae0 con 0x7f43480b5fa0 2024-09-21T01:50:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.455+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43480cfc40 con 0x7f43480b5fa0 2024-09-21T01:50:19.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.456+0000 7f4345ffb640 1 -- 172.21.15.40:0/1281090250 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4338042070 con 0x7f43480b5fa0 2024-09-21T01:50:19.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.457+0000 7f4345ffb640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4334078b90 0x7f433407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.457+0000 7f4345ffb640 1 -- 172.21.15.40:0/1281090250 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f43380bbab0 con 0x7f43480b5fa0 2024-09-21T01:50:19.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.457+0000 7f434cd33640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4334078b90 0x7f433407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.458+0000 7f434cd33640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4334078b90 0x7f433407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f43480c7e50 tx=0x7f433c00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:19.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.462+0000 7f4345ffb640 1 -- 172.21.15.40:0/1281090250 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4338083c80 con 0x7f43480b5fa0 2024-09-21T01:50:19.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.657+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f43480c8300 con 0x7f43480b5fa0 2024-09-21T01:50:19.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.657+0000 7f4345ffb640 1 -- 172.21.15.40:0/1281090250 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f43380886b0 con 0x7f43480b5fa0 2024-09-21T01:50:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:19.658 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-09-21T01:50:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-21T01:50:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-09-21T01:50:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-09-21T01:50:19.658 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-21T01:50:19.658 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-09-21T01:50:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4334078b90 msgr2=0x7f433407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4334078b90 0x7f433407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f43480c7e50 tx=0x7f433c00b2e0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b5fa0 msgr2=0x7f434815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b5fa0 0x7f434815f240 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4338009ca0 tx=0x7f43380042e0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 shutdown_connections 2024-09-21T01:50:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4334078b90 0x7f433407b0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43480ced80 0x7f43480ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43480b9970 0x7f43480ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 --2- 172.21.15.40:0/1281090250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43480b5fa0 0x7f434815f240 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 >> 172.21.15.40:0/1281090250 conn(0x7f434809d7f0 msgr2=0x7f4348161ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:19.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 shutdown_connections 2024-09-21T01:50:19.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.660+0000 7f434f798640 1 -- 172.21.15.40:0/1281090250 wait complete. 2024-09-21T01:50:19.671 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T01:50:19.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T01:50:19.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.792+0000 7fafc5590640 1 -- 172.21.15.40:0/3708419146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00b3e60 msgr2=0x7fafc00d3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.792+0000 7fafc5590640 1 --2- 172.21.15.40:0/3708419146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00b3e60 0x7fafc00d3da0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fafb0005fd0 tx=0x7fafb002aa90 comp rx=0 tx=0).stop 2024-09-21T01:50:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.792+0000 7fafc5590640 1 -- 172.21.15.40:0/3708419146 shutdown_connections 2024-09-21T01:50:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.792+0000 7fafc5590640 1 --2- 172.21.15.40:0/3708419146 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fafc00d0dd0 0x7fafc00d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.792+0000 7fafc5590640 1 --2- 172.21.15.40:0/3708419146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00b3e60 0x7fafc00d3da0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.792+0000 7fafc5590640 1 -- 172.21.15.40:0/3708419146 >> 172.21.15.40:0/3708419146 conn(0x7fafc009d800 msgr2=0x7fafc008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:19.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.792+0000 7fafc5590640 1 -- 172.21.15.40:0/3708419146 shutdown_connections 2024-09-21T01:50:19.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.792+0000 7fafc5590640 1 -- 172.21.15.40:0/3708419146 wait complete. 2024-09-21T01:50:19.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.794+0000 7fafc5590640 1 Processor -- start 2024-09-21T01:50:19.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.794+0000 7fafc5590640 1 -- start start 2024-09-21T01:50:19.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafc5590640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fafc00b3e60 0x7fafc01f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafc5590640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafc00b5ef0 0x7fafc01f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafc5590640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00d0dd0 0x7fafc01f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafc5590640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fafc00b4900 con 0x7fafc00d0dd0 2024-09-21T01:50:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafc5590640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fafc00b4780 con 0x7fafc00b5ef0 2024-09-21T01:50:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafc5590640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fafc00d3470 con 0x7fafc00b3e60 2024-09-21T01:50:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafbf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00d0dd0 0x7fafc01f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafbf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00d0dd0 0x7fafc01f8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34018/0 (socket says 172.21.15.40:34018) 2024-09-21T01:50:19.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafbf7fe640 1 -- 172.21.15.40:0/3393660042 learned_addr learned my addr 172.21.15.40:0/3393660042 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafbeffd640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fafc00b3e60 0x7fafc01f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.795+0000 7fafbe7fc640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafc00b5ef0 0x7fafc01f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafbf7fe640 1 -- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fafc00b3e60 msgr2=0x7fafc01f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafbf7fe640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fafc00b3e60 0x7fafc01f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafbf7fe640 1 -- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafc00b5ef0 msgr2=0x7fafc01f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafbf7fe640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafc00b5ef0 0x7fafc01f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:19.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafbf7fe640 1 -- 172.21.15.40:0/3393660042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc00cc750 con 0x7fafc00d0dd0 2024-09-21T01:50:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafbe7fc640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafc00b5ef0 0x7fafc01f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafbf7fe640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00d0dd0 0x7fafc01f8f80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fafb800c390 tx=0x7fafb800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafb77fe640 1 -- 172.21.15.40:0/3393660042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8017070 con 0x7fafc00d0dd0 2024-09-21T01:50:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafb77fe640 1 -- 172.21.15.40:0/3393660042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb80035f0 con 0x7fafc00d0dd0 2024-09-21T01:50:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafb77fe640 1 -- 172.21.15.40:0/3393660042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8003a40 con 0x7fafc00d0dd0 2024-09-21T01:50:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc00cca30 con 0x7fafc00d0dd0 2024-09-21T01:50:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.796+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc00ccff0 con 0x7fafc00d0dd0 2024-09-21T01:50:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.797+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc01f6160 con 0x7fafc00d0dd0 2024-09-21T01:50:19.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.798+0000 7fafb77fe640 1 -- 172.21.15.40:0/3393660042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafb801a070 con 0x7fafc00d0dd0 2024-09-21T01:50:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.798+0000 7fafb77fe640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fafa0078bc0 0x7fafa007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.798+0000 7fafb77fe640 1 -- 172.21.15.40:0/3393660042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fafb8099a90 con 0x7fafc00d0dd0 2024-09-21T01:50:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.799+0000 7fafbeffd640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fafa0078bc0 0x7fafa007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.799+0000 7fafbeffd640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fafa0078bc0 0x7fafa007b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fafb0035000 tx=0x7fafb0038040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:19.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.803+0000 7fafb77fe640 1 -- 172.21.15.40:0/3393660042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fafb80622b0 con 0x7fafc00d0dd0 2024-09-21T01:50:19.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:19.994+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fafc00b6af0 con 0x7fafc00d0dd0 2024-09-21T01:50:20.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.909+0000 7fafb77fe640 1 -- 172.21.15.40:0/3393660042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7fafb8061bb0 con 0x7fafc00d0dd0 2024-09-21T01:50:20.910 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-09-21T01:50:20.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.913+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fafa0078bc0 msgr2=0x7fafa007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.913+0000 7fafc5590640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fafa0078bc0 0x7fafa007b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fafb0035000 tx=0x7fafb0038040 comp rx=0 tx=0).stop 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.913+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00d0dd0 msgr2=0x7fafc01f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.913+0000 7fafc5590640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00d0dd0 0x7fafc01f8f80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fafb800c390 tx=0x7fafb800c850 comp rx=0 tx=0).stop 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.914+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 shutdown_connections 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.914+0000 7fafc5590640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fafa0078bc0 0x7fafa007b0d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.914+0000 7fafc5590640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafc00d0dd0 0x7fafc01f8f80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.914+0000 7fafc5590640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafc00b5ef0 0x7fafc01f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.914+0000 7fafc5590640 1 --2- 172.21.15.40:0/3393660042 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fafc00b3e60 0x7fafc01f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.914+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 >> 172.21.15.40:0/3393660042 conn(0x7fafc009d800 msgr2=0x7fafc00cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:20.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.915+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 shutdown_connections 2024-09-21T01:50:20.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:20.915+0000 7fafc5590640 1 -- 172.21.15.40:0/3393660042 wait complete. 2024-09-21T01:50:20.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T01:50:21.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.062+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3631935839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 msgr2=0x7fb1a40cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:21.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.062+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3631935839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 0x7fb1a40cfb70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40d44d0 tx=0x7fb19402a560 comp rx=0 tx=0).stop 2024-09-21T01:50:21.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.062+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3631935839 shutdown_connections 2024-09-21T01:50:21.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.062+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3631935839 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb1a40d0e10 0x7fb1a40d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:21.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.062+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3631935839 >> v2:172.21.15.139:3300/0 conn(0x7fb1a406e3c0 0x7fb1a406f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:21.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.062+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3631935839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 0x7fb1a40cfb70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:21.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.062+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3631935839 >> 172.21.15.40:0/3631935839 conn(0x7fb1a408bfc0 msgr2=0x7fb1a409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:21.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.063+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3631935839 shutdown_connections 2024-09-21T01:50:21.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.063+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3631935839 wait complete. 2024-09-21T01:50:21.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.064+0000 7fb1a9cb4640 1 Processor -- start 2024-09-21T01:50:21.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.065+0000 7fb1a9cb4640 1 -- start start 2024-09-21T01:50:21.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a9cb4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1a406e3c0 0x7fb1a415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a9cb4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 0x7fb1a40b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a9cb4640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb1a40d0e10 0x7fb1a4156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a9cb4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a40d2ad0 con 0x7fb1a40b3a60 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a9cb4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a40d2950 con 0x7fb1a406e3c0 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a9cb4640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a40d2c50 con 0x7fb1a40d0e10 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 0x7fb1a40b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 0x7fb1a40b85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47462/0 (socket says 172.21.15.40:47462) 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a2ffd640 1 -- 172.21.15.40:0/3189450220 learned_addr learned my addr 172.21.15.40:0/3189450220 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a37fe640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1a406e3c0 0x7fb1a415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a3fff640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb1a40d0e10 0x7fb1a4156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a2ffd640 1 -- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb1a40d0e10 msgr2=0x7fb1a4156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a2ffd640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb1a40d0e10 0x7fb1a4156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:21.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a2ffd640 1 -- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1a406e3c0 msgr2=0x7fb1a415fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:21.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a2ffd640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1a406e3c0 0x7fb1a415fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:21.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a2ffd640 1 -- 172.21.15.40:0/3189450220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a40b4b10 con 0x7fb1a40b3a60 2024-09-21T01:50:21.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a37fe640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1a406e3c0 0x7fb1a415fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:21.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.066+0000 7fb1a2ffd640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 0x7fb1a40b85c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb19800c940 tx=0x7fb19800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:21.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.067+0000 7fb18bfff640 1 -- 172.21.15.40:0/3189450220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb198007bb0 con 0x7fb1a40b3a60 2024-09-21T01:50:21.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.067+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a40b4df0 con 0x7fb1a40b3a60 2024-09-21T01:50:21.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.067+0000 7fb18bfff640 1 -- 172.21.15.40:0/3189450220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb198007e40 con 0x7fb1a40b3a60 2024-09-21T01:50:21.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.067+0000 7fb18bfff640 1 -- 172.21.15.40:0/3189450220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19800f670 con 0x7fb1a40b3a60 2024-09-21T01:50:21.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.067+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a40b56c0 con 0x7fb1a40b3a60 2024-09-21T01:50:21.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.068+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a40d1220 con 0x7fb1a40b3a60 2024-09-21T01:50:21.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.069+0000 7fb18bfff640 1 -- 172.21.15.40:0/3189450220 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb19800f810 con 0x7fb1a40b3a60 2024-09-21T01:50:21.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.069+0000 7fb18bfff640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb190078b90 0x7fb19007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:21.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.070+0000 7fb18bfff640 1 -- 172.21.15.40:0/3189450220 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7fb19809b390 con 0x7fb1a40b3a60 2024-09-21T01:50:21.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.070+0000 7fb1a37fe640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb190078b90 0x7fb19007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:21.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.070+0000 7fb1a37fe640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb190078b90 0x7fb19007b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb194033000 tx=0x7fb194004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:21.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.074+0000 7fb18bfff640 1 -- 172.21.15.40:0/3189450220 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb1a40d1220 con 0x7fb1a40b3a60 2024-09-21T01:50:21.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.266+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb1a40c7db0 con 0x7fb1a40b3a60 2024-09-21T01:50:21.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.915+0000 7fb18bfff640 1 -- 172.21.15.40:0/3189450220 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7fb1a40c7db0 con 0x7fb1a40b3a60 2024-09-21T01:50:21.916 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-09-21T01:50:21.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.921+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb190078b90 msgr2=0x7fb19007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:21.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.921+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb190078b90 0x7fb19007b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb194033000 tx=0x7fb194004730 comp rx=0 tx=0).stop 2024-09-21T01:50:21.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.921+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 msgr2=0x7fb1a40b85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:21.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.921+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 0x7fb1a40b85c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb19800c940 tx=0x7fb19800ce00 comp rx=0 tx=0).stop 2024-09-21T01:50:21.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.923+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 shutdown_connections 2024-09-21T01:50:21.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.924+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb190078b90 0x7fb19007b0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:21.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.924+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb1a40d0e10 0x7fb1a4156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:21.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.924+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1a40b3a60 0x7fb1a40b85c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:21.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.924+0000 7fb1a9cb4640 1 --2- 172.21.15.40:0/3189450220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb1a406e3c0 0x7fb1a415fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:21.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.924+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 >> 172.21.15.40:0/3189450220 conn(0x7fb1a408bfc0 msgr2=0x7fb1a40d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:21.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.928+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 shutdown_connections 2024-09-21T01:50:21.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:21.930+0000 7fb1a9cb4640 1 -- 172.21.15.40:0/3189450220 wait complete. 2024-09-21T01:50:21.951 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T01:50:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.091+0000 7f157b44d640 1 -- 172.21.15.40:0/2500979391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f157406f4b0 msgr2=0x7f15740d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.091+0000 7f157b44d640 1 --2- 172.21.15.40:0/2500979391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f157406f4b0 0x7f15740d3330 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1568009900 tx=0x7f156802a580 comp rx=0 tx=0).stop 2024-09-21T01:50:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.091+0000 7f157b44d640 1 -- 172.21.15.40:0/2500979391 shutdown_connections 2024-09-21T01:50:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.091+0000 7f157b44d640 1 --2- 172.21.15.40:0/2500979391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f157406f4b0 0x7f15740d3330 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:22.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.091+0000 7f157b44d640 1 --2- 172.21.15.40:0/2500979391 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f157406e170 0x7f15740b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:22.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.091+0000 7f157b44d640 1 -- 172.21.15.40:0/2500979391 >> 172.21.15.40:0/2500979391 conn(0x7f157408bfc0 msgr2=0x7f157409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:22.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.091+0000 7f157b44d640 1 -- 172.21.15.40:0/2500979391 shutdown_connections 2024-09-21T01:50:22.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.091+0000 7f157b44d640 1 -- 172.21.15.40:0/2500979391 wait complete. 2024-09-21T01:50:22.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.093+0000 7f157b44d640 1 Processor -- start 2024-09-21T01:50:22.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.093+0000 7f157b44d640 1 -- start start 2024-09-21T01:50:22.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.094+0000 7f157b44d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157406f4b0 0x7f15740ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:22.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.094+0000 7f157b44d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15740d3870 0x7f1574151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:22.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.094+0000 7f157b44d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f15741f6490 0x7f15741f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:22.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.094+0000 7f157b44d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f15740d0e60 con 0x7f15740d3870 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.094+0000 7f157b44d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f15740d0ce0 con 0x7f157406f4b0 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.094+0000 7f157b44d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f15740d0fe0 con 0x7f15741f6490 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.094+0000 7f15789e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15740d3870 0x7f1574151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.094+0000 7f15789e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15740d3870 0x7f1574151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47466/0 (socket says 172.21.15.40:47466) 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.094+0000 7f15789e8640 1 -- 172.21.15.40:0/1093279793 learned_addr learned my addr 172.21.15.40:0/1093279793 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f15791e9640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157406f4b0 0x7f15740ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f15799ea640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f15741f6490 0x7f15741f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f15789e8640 1 -- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f15741f6490 msgr2=0x7f15741f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f15789e8640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f15741f6490 0x7f15741f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f15789e8640 1 -- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157406f4b0 msgr2=0x7f15740ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f15789e8640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157406f4b0 0x7f15740ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f15789e8640 1 -- 172.21.15.40:0/1093279793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15741f6970 con 0x7f15740d3870 2024-09-21T01:50:22.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f15791e9640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157406f4b0 0x7f15740ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f15789e8640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15740d3870 0x7f1574151070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1568006010 tx=0x7f1568003880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f1571ffb640 1 -- 172.21.15.40:0/1093279793 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156803e030 con 0x7f15740d3870 2024-09-21T01:50:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f1571ffb640 1 -- 172.21.15.40:0/1093279793 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1568003d70 con 0x7f15740d3870 2024-09-21T01:50:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15740c9070 con 0x7f15740d3870 2024-09-21T01:50:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f1571ffb640 1 -- 172.21.15.40:0/1093279793 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1568035040 con 0x7f15740d3870 2024-09-21T01:50:22.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.095+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15740c9630 con 0x7f15740d3870 2024-09-21T01:50:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.096+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15740d1500 con 0x7f15740d3870 2024-09-21T01:50:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.097+0000 7f1571ffb640 1 -- 172.21.15.40:0/1093279793 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1568041030 con 0x7f15740d3870 2024-09-21T01:50:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.098+0000 7f1571ffb640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1560078b90 0x7f156007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.098+0000 7f1571ffb640 1 -- 172.21.15.40:0/1093279793 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f15680bb410 con 0x7f15740d3870 2024-09-21T01:50:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.098+0000 7f15791e9640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1560078b90 0x7f156007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:22.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.099+0000 7f15791e9640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1560078b90 0x7f156007b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f156c005fd0 tx=0x7f156c00f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:22.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.103+0000 7f1571ffb640 1 -- 172.21.15.40:0/1093279793 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1568083940 con 0x7f15740d3870 2024-09-21T01:50:22.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.333+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f15740cf730 con 0x7f15740d3870 2024-09-21T01:50:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.916+0000 7f1571ffb640 1 -- 172.21.15.40:0/1093279793 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f1568083240 con 0x7f15740d3870 2024-09-21T01:50:22.917 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 4 and data pool 5 2024-09-21T01:50:22.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.926+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1560078b90 msgr2=0x7f156007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:22.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.926+0000 7f157b44d640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1560078b90 0x7f156007b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f156c005fd0 tx=0x7f156c00f360 comp rx=0 tx=0).stop 2024-09-21T01:50:22.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.926+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15740d3870 msgr2=0x7f1574151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:22.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.926+0000 7f157b44d640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15740d3870 0x7f1574151070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1568006010 tx=0x7f1568003880 comp rx=0 tx=0).stop 2024-09-21T01:50:22.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.927+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 shutdown_connections 2024-09-21T01:50:22.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.927+0000 7f157b44d640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f1560078b90 0x7f156007b0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:22.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.927+0000 7f157b44d640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f15741f6490 0x7f15741f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:22.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.927+0000 7f157b44d640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15740d3870 0x7f1574151070 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:22.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.927+0000 7f157b44d640 1 --2- 172.21.15.40:0/1093279793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f157406f4b0 0x7f15740ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:22.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.927+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 >> 172.21.15.40:0/1093279793 conn(0x7f157408bfc0 msgr2=0x7f1574068f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:22.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.930+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 shutdown_connections 2024-09-21T01:50:22.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:22.930+0000 7f157b44d640 1 -- 172.21.15.40:0/1093279793 wait complete. 2024-09-21T01:50:22.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:50:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.075+0000 7fb85e7a9640 1 -- 172.21.15.40:0/2935820999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb840003a50 msgr2=0x7fb840003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.075+0000 7fb85e7a9640 1 --2- 172.21.15.40:0/2935820999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb840003a50 0x7fb840003ec0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb848006fd0 tx=0x7fb840005830 comp rx=0 tx=0).stop 2024-09-21T01:50:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.075+0000 7fb85e7a9640 1 -- 172.21.15.40:0/2935820999 shutdown_connections 2024-09-21T01:50:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.075+0000 7fb85e7a9640 1 --2- 172.21.15.40:0/2935820999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb840003a50 0x7fb840003ec0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.075+0000 7fb85e7a9640 1 -- 172.21.15.40:0/2935820999 >> 172.21.15.40:0/2935820999 conn(0x7fb8580cee20 msgr2=0x7fb8580cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.075+0000 7fb85e7a9640 1 -- 172.21.15.40:0/2935820999 shutdown_connections 2024-09-21T01:50:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.075+0000 7fb85e7a9640 1 -- 172.21.15.40:0/2935820999 wait complete. 2024-09-21T01:50:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.077+0000 7fb85e7a9640 1 Processor -- start 2024-09-21T01:50:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.077+0000 7fb85e7a9640 1 -- start start 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.078+0000 7fb85e7a9640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb840003a50 0x7fb8580cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.078+0000 7fb85e7a9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8581f3d80 0x7fb85814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.078+0000 7fb85e7a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb858153280 0x7fb8581526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.078+0000 7fb85e7a9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580b3fa0 con 0x7fb858153280 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.078+0000 7fb85e7a9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580b3e20 con 0x7fb8581f3d80 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.078+0000 7fb85e7a9640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fb8580b4120 con 0x7fb840003a50 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85cd46640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb858153280 0x7fb8581526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85cd46640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb858153280 0x7fb8581526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47486/0 (socket says 172.21.15.40:47486) 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85cd46640 1 -- 172.21.15.40:0/3413475420 learned_addr learned my addr 172.21.15.40:0/3413475420 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb8577fe640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8581f3d80 0x7fb85814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb857fff640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb840003a50 0x7fb8580cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85cd46640 1 -- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb840003a50 msgr2=0x7fb8580cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85cd46640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb840003a50 0x7fb8580cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85cd46640 1 -- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8581f3d80 msgr2=0x7fb85814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85cd46640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8581f3d80 0x7fb85814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85cd46640 1 -- 172.21.15.40:0/3413475420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb858154120 con 0x7fb858153280 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85cd46640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb858153280 0x7fb8581526e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb858075010 tx=0x7fb85000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb854ff9640 1 -- 172.21.15.40:0/3413475420 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850003d80 con 0x7fb858153280 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb854ff9640 1 -- 172.21.15.40:0/3413475420 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb850004b20 con 0x7fb858153280 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8581f32a0 con 0x7fb858153280 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb854ff9640 1 -- 172.21.15.40:0/3413475420 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850004030 con 0x7fb858153280 2024-09-21T01:50:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.079+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8581f3860 con 0x7fb858153280 2024-09-21T01:50:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.080+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8580b4680 con 0x7fb858153280 2024-09-21T01:50:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.081+0000 7fb854ff9640 1 -- 172.21.15.40:0/3413475420 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8500041d0 con 0x7fb858153280 2024-09-21T01:50:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.081+0000 7fb854ff9640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb844078b90 0x7fb84407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.082+0000 7fb854ff9640 1 -- 172.21.15.40:0/3413475420 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fb85009bc10 con 0x7fb858153280 2024-09-21T01:50:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.082+0000 7fb857fff640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb844078b90 0x7fb84407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.082+0000 7fb857fff640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb844078b90 0x7fb84407b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb848033000 tx=0x7fb8580ccc00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:23.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.086+0000 7fb854ff9640 1 -- 172.21.15.40:0/3413475420 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb850064050 con 0x7fb858153280 2024-09-21T01:50:23.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.274+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8580d1d60 con 0x7fb858153280 2024-09-21T01:50:23.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.275+0000 7fb854ff9640 1 -- 172.21.15.40:0/3413475420 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16754 (secure 0 0 0) 0x7fb85009f020 con 0x7fb858153280 2024-09-21T01:50:23.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:23.276 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:50:22.334806+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:50:19.998609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T01:50:21.270421+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:50:23.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.277+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb844078b90 msgr2=0x7fb84407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb844078b90 0x7fb84407b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb848033000 tx=0x7fb8580ccc00 comp rx=0 tx=0).stop 2024-09-21T01:50:23.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb858153280 msgr2=0x7fb8581526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb858153280 0x7fb8581526e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb858075010 tx=0x7fb85000f790 comp rx=0 tx=0).stop 2024-09-21T01:50:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 shutdown_connections 2024-09-21T01:50:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fb844078b90 0x7fb84407b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb858153280 0x7fb8581526e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8581f3d80 0x7fb85814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 --2- 172.21.15.40:0/3413475420 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fb840003a50 0x7fb8580cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 >> 172.21.15.40:0/3413475420 conn(0x7fb8580cee20 msgr2=0x7fb8580b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 shutdown_connections 2024-09-21T01:50:23.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.278+0000 7fb85e7a9640 1 -- 172.21.15.40:0/3413475420 wait complete. 2024-09-21T01:50:23.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:50:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.406+0000 7fca91f9d640 1 -- 172.21.15.40:0/1462646882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c163110 msgr2=0x7fca8c0b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.406+0000 7fca91f9d640 1 --2- 172.21.15.40:0/1462646882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c163110 0x7fca8c0b3b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0d4250 tx=0x7fca7c02a560 comp rx=0 tx=0).stop 2024-09-21T01:50:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.406+0000 7fca91f9d640 1 -- 172.21.15.40:0/1462646882 shutdown_connections 2024-09-21T01:50:23.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.406+0000 7fca91f9d640 1 --2- 172.21.15.40:0/1462646882 >> v2:172.21.15.139:3300/0 conn(0x7fca8c162470 0x7fca8c162880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.406+0000 7fca91f9d640 1 --2- 172.21.15.40:0/1462646882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c163110 0x7fca8c0b3b50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.406+0000 7fca91f9d640 1 -- 172.21.15.40:0/1462646882 >> 172.21.15.40:0/1462646882 conn(0x7fca8c09d6a0 msgr2=0x7fca8c0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:23.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.406+0000 7fca91f9d640 1 -- 172.21.15.40:0/1462646882 shutdown_connections 2024-09-21T01:50:23.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.406+0000 7fca91f9d640 1 -- 172.21.15.40:0/1462646882 wait complete. 2024-09-21T01:50:23.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.408+0000 7fca91f9d640 1 Processor -- start 2024-09-21T01:50:23.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.408+0000 7fca91f9d640 1 -- start start 2024-09-21T01:50:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca91f9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c0b5a20 0x7fca8c0a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca91f9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca8c162470 0x7fca8c0c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca91f9d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca8c163110 0x7fca8c1f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca91f9d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c0cfd30 con 0x7fca8c0b5a20 2024-09-21T01:50:23.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca91f9d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c0cfbb0 con 0x7fca8c162470 2024-09-21T01:50:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca91f9d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fca8c0cfeb0 con 0x7fca8c163110 2024-09-21T01:50:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca90f9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c0b5a20 0x7fca8c0a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca90f9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c0b5a20 0x7fca8c0a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47514/0 (socket says 172.21.15.40:47514) 2024-09-21T01:50:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca90f9b640 1 -- 172.21.15.40:0/4087289314 learned_addr learned my addr 172.21.15.40:0/4087289314 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca9179c640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca8c163110 0x7fca8c1f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.409+0000 7fca8bfff640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca8c162470 0x7fca8c0c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca90f9b640 1 -- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca8c163110 msgr2=0x7fca8c1f9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca90f9b640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca8c163110 0x7fca8c1f9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca90f9b640 1 -- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca8c162470 msgr2=0x7fca8c0c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca90f9b640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca8c162470 0x7fca8c0c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca90f9b640 1 -- 172.21.15.40:0/4087289314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c09f8b0 con 0x7fca8c0b5a20 2024-09-21T01:50:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca90f9b640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c0b5a20 0x7fca8c0a1d60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fca7c02ab50 tx=0x7fca7c0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca897fa640 1 -- 172.21.15.40:0/4087289314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c005cf0 con 0x7fca8c0b5a20 2024-09-21T01:50:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca897fa640 1 -- 172.21.15.40:0/4087289314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca7c031c40 con 0x7fca8c0b5a20 2024-09-21T01:50:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8c09fb90 con 0x7fca8c0b5a20 2024-09-21T01:50:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca897fa640 1 -- 172.21.15.40:0/4087289314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c033330 con 0x7fca8c0b5a20 2024-09-21T01:50:23.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.410+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8c0a0150 con 0x7fca8c0b5a20 2024-09-21T01:50:23.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.411+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca8c0d1550 con 0x7fca8c0b5a20 2024-09-21T01:50:23.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.412+0000 7fca897fa640 1 -- 172.21.15.40:0/4087289314 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca7c0334d0 con 0x7fca8c0b5a20 2024-09-21T01:50:23.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.412+0000 7fca897fa640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fca78078b90 0x7fca7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.413+0000 7fca897fa640 1 -- 172.21.15.40:0/4087289314 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fca7c0bc060 con 0x7fca8c0b5a20 2024-09-21T01:50:23.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.413+0000 7fca8bfff640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fca78078b90 0x7fca7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.414+0000 7fca8bfff640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fca78078b90 0x7fca7807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0d51e0 tx=0x7fca80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:23.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.417+0000 7fca897fa640 1 -- 172.21.15.40:0/4087289314 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fca7c03f030 con 0x7fca8c0b5a20 2024-09-21T01:50:23.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.608+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca8c08e450 con 0x7fca8c0b5a20 2024-09-21T01:50:23.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.609+0000 7fca897fa640 1 -- 172.21.15.40:0/4087289314 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16754 (secure 0 0 0) 0x7fca7c031770 con 0x7fca8c0b5a20 2024-09-21T01:50:23.610 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:23.610 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:50:22.334806+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:50:19.998609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T01:50:21.270421+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:50:23.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.611+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fca78078b90 msgr2=0x7fca7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.611+0000 7fca91f9d640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fca78078b90 0x7fca7807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca8c0d51e0 tx=0x7fca80009040 comp rx=0 tx=0).stop 2024-09-21T01:50:23.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.611+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c0b5a20 msgr2=0x7fca8c0a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.611+0000 7fca91f9d640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c0b5a20 0x7fca8c0a1d60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fca7c02ab50 tx=0x7fca7c0052f0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.612+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 shutdown_connections 2024-09-21T01:50:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.612+0000 7fca91f9d640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fca78078b90 0x7fca7807b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.612+0000 7fca91f9d640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fca8c163110 0x7fca8c1f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.612+0000 7fca91f9d640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca8c162470 0x7fca8c0c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.612+0000 7fca91f9d640 1 --2- 172.21.15.40:0/4087289314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca8c0b5a20 0x7fca8c0a1d60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.612+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 >> 172.21.15.40:0/4087289314 conn(0x7fca8c09d6a0 msgr2=0x7fca8c06e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.612+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 shutdown_connections 2024-09-21T01:50:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.612+0000 7fca91f9d640 1 -- 172.21.15.40:0/4087289314 wait complete. 2024-09-21T01:50:23.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T01:50:23.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.742+0000 7fdccd41d640 1 -- 172.21.15.40:0/1627936659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 msgr2=0x7fdcc806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.742+0000 7fdccd41d640 1 --2- 172.21.15.40:0/1627936659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 0x7fdcc806f7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdcc808c950 tx=0x7fdcb002a5f0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.742+0000 7fdccd41d640 1 -- 172.21.15.40:0/1627936659 shutdown_connections 2024-09-21T01:50:23.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.742+0000 7fdccd41d640 1 --2- 172.21.15.40:0/1627936659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 0x7fdcc806f7a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.742+0000 7fdccd41d640 1 --2- 172.21.15.40:0/1627936659 >> v2:172.21.15.139:3300/0 conn(0x7fdcc80b3a60 0x7fdcc80cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.742+0000 7fdccd41d640 1 -- 172.21.15.40:0/1627936659 >> 172.21.15.40:0/1627936659 conn(0x7fdcc808bfc0 msgr2=0x7fdcc809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:23.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.743+0000 7fdccd41d640 1 -- 172.21.15.40:0/1627936659 shutdown_connections 2024-09-21T01:50:23.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.743+0000 7fdccd41d640 1 -- 172.21.15.40:0/1627936659 wait complete. 2024-09-21T01:50:23.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.744+0000 7fdccd41d640 1 Processor -- start 2024-09-21T01:50:23.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.744+0000 7fdccd41d640 1 -- start start 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdccd41d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 0x7fdcc815fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdccd41d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcc80b3a60 0x7fdcc81604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdccd41d640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcc80d0e10 0x7fdcc80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdccd41d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc80d2c40 con 0x7fdcc806e3c0 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdccd41d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc80d2ac0 con 0x7fdcc80b3a60 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdccd41d640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc80d2dc0 con 0x7fdcc80d0e10 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 0x7fdcc815fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 0x7fdcc815fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47534/0 (socket says 172.21.15.40:47534) 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc6ffd640 1 -- 172.21.15.40:0/388152766 learned_addr learned my addr 172.21.15.40:0/388152766 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc6ffd640 1 -- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcc80d0e10 msgr2=0x7fdcc80b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcbffff640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcc80b3a60 0x7fdcc81604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc77fe640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcc80d0e10 0x7fdcc80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc6ffd640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcc80d0e10 0x7fdcc80b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc6ffd640 1 -- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcc80b3a60 msgr2=0x7fdcc81604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc6ffd640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcc80b3a60 0x7fdcc81604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc6ffd640 1 -- 172.21.15.40:0/388152766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc80b8e60 con 0x7fdcc806e3c0 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcbffff640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcc80b3a60 0x7fdcc81604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc77fe640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcc80d0e10 0x7fdcc80b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.746+0000 7fdcc6ffd640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 0x7fdcc815fdb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c9a0 tx=0x7fdcb800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.747+0000 7fdcbf7fe640 1 -- 172.21.15.40:0/388152766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8007bb0 con 0x7fdcc806e3c0 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.747+0000 7fdcbf7fe640 1 -- 172.21.15.40:0/388152766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcb8007e40 con 0x7fdcc806e3c0 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.747+0000 7fdcbf7fe640 1 -- 172.21.15.40:0/388152766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800f690 con 0x7fdcc806e3c0 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.747+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc80b9140 con 0x7fdcc806e3c0 2024-09-21T01:50:23.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.747+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc815f5b0 con 0x7fdcc806e3c0 2024-09-21T01:50:23.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.748+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc80d3270 con 0x7fdcc806e3c0 2024-09-21T01:50:23.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.749+0000 7fdcbf7fe640 1 -- 172.21.15.40:0/388152766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdcb8018400 con 0x7fdcc806e3c0 2024-09-21T01:50:23.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.749+0000 7fdcbf7fe640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdca8078bc0 0x7fdca807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:23.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.749+0000 7fdcbf7fe640 1 -- 172.21.15.40:0/388152766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fdcb809b440 con 0x7fdcc806e3c0 2024-09-21T01:50:23.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.749+0000 7fdcbffff640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdca8078bc0 0x7fdca807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:23.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.750+0000 7fdcbffff640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdca8078bc0 0x7fdca807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0033000 tx=0x7fdcb0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:23.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.754+0000 7fdcbf7fe640 1 -- 172.21.15.40:0/388152766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdcb8014030 con 0x7fdcc806e3c0 2024-09-21T01:50:23.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:23.988+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdcc806fac0 con 0x7fdcc806e3c0 2024-09-21T01:50:24.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.942+0000 7fdcbf7fe640 1 -- 172.21.15.40:0/388152766 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fdcb80639a0 con 0x7fdcc806e3c0 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdca8078bc0 msgr2=0x7fdca807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdca8078bc0 0x7fdca807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0033000 tx=0x7fdcb0004730 comp rx=0 tx=0).stop 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 msgr2=0x7fdcc815fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 0x7fdcc815fdb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c9a0 tx=0x7fdcb800ce60 comp rx=0 tx=0).stop 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 shutdown_connections 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fdca8078bc0 0x7fdca807b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fdcc80d0e10 0x7fdcc80b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdcc80b3a60 0x7fdcc81604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 --2- 172.21.15.40:0/388152766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdcc806e3c0 0x7fdcc815fdb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 >> 172.21.15.40:0/388152766 conn(0x7fdcc808bfc0 msgr2=0x7fdcc80d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 shutdown_connections 2024-09-21T01:50:24.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:24.946+0000 7fdccd41d640 1 -- 172.21.15.40:0/388152766 wait complete. 2024-09-21T01:50:24.960 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T01:50:24.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T01:50:25.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.087+0000 7f0df012b640 1 -- 172.21.15.40:0/3156731069 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0de80b66b0 msgr2=0x7f0de80b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:25.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.087+0000 7f0df012b640 1 --2- 172.21.15.40:0/3156731069 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0de80b66b0 0x7f0de80b9900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009860 tx=0x7f0dd802a540 comp rx=0 tx=0).stop 2024-09-21T01:50:25.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.088+0000 7f0df012b640 1 -- 172.21.15.40:0/3156731069 shutdown_connections 2024-09-21T01:50:25.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.088+0000 7f0df012b640 1 --2- 172.21.15.40:0/3156731069 >> v2:172.21.15.139:3300/0 conn(0x7f0de80b3910 0x7f0de806e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:25.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.088+0000 7f0df012b640 1 --2- 172.21.15.40:0/3156731069 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0de80b66b0 0x7f0de80b9900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:25.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.088+0000 7f0df012b640 1 -- 172.21.15.40:0/3156731069 >> 172.21.15.40:0/3156731069 conn(0x7f0de809d830 msgr2=0x7f0de80d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:25.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.088+0000 7f0df012b640 1 -- 172.21.15.40:0/3156731069 shutdown_connections 2024-09-21T01:50:25.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.088+0000 7f0df012b640 1 -- 172.21.15.40:0/3156731069 wait complete. 2024-09-21T01:50:25.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.089+0000 7f0df012b640 1 Processor -- start 2024-09-21T01:50:25.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.089+0000 7f0df012b640 1 -- start start 2024-09-21T01:50:25.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0df012b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0de80b3910 0x7f0de80cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:25.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0df012b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0de80d4c30 0x7f0de81508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:25.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0df012b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8150e30 0x7f0de81f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:25.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0df012b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0de806ec20 con 0x7f0de8150e30 2024-09-21T01:50:25.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0df012b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0de806eaa0 con 0x7f0de80d4c30 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0df012b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f0de806eda0 con 0x7f0de80b3910 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dee6c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8150e30 0x7f0de81f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dee6c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8150e30 0x7f0de81f8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47550/0 (socket says 172.21.15.40:47550) 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dee6c8640 1 -- 172.21.15.40:0/2497863055 learned_addr learned my addr 172.21.15.40:0/2497863055 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0ded6c6640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0de80d4c30 0x7f0de81508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dedec7640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0de80b3910 0x7f0de80cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dee6c8640 1 -- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0de80b3910 msgr2=0x7f0de80cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dee6c8640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0de80b3910 0x7f0de80cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dee6c8640 1 -- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0de80d4c30 msgr2=0x7f0de81508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dee6c8640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0de80d4c30 0x7f0de81508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dee6c8640 1 -- 172.21.15.40:0/2497863055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de8160240 con 0x7f0de8150e30 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.091+0000 7f0dee6c8640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8150e30 0x7f0de81f8a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e940 tx=0x7f0de000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.092+0000 7f0dde7fc640 1 -- 172.21.15.40:0/2497863055 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de000cd80 con 0x7f0de8150e30 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.092+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de8151680 con 0x7f0de8150e30 2024-09-21T01:50:25.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.092+0000 7f0dde7fc640 1 -- 172.21.15.40:0/2497863055 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0de0004020 con 0x7f0de8150e30 2024-09-21T01:50:25.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.092+0000 7f0dde7fc640 1 -- 172.21.15.40:0/2497863055 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0004470 con 0x7f0de8150e30 2024-09-21T01:50:25.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.092+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de8151c40 con 0x7f0de8150e30 2024-09-21T01:50:25.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.093+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de80d42b0 con 0x7f0de8150e30 2024-09-21T01:50:25.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.094+0000 7f0dde7fc640 1 -- 172.21.15.40:0/2497863055 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0de00035f0 con 0x7f0de8150e30 2024-09-21T01:50:25.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.094+0000 7f0dde7fc640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0dcc078bc0 0x7f0dcc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:25.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.094+0000 7f0dde7fc640 1 -- 172.21.15.40:0/2497863055 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0de009b730 con 0x7f0de8150e30 2024-09-21T01:50:25.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.095+0000 7f0dedec7640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0dcc078bc0 0x7f0dcc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:25.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.095+0000 7f0dedec7640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0dcc078bc0 0x7f0dcc07b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0de40020a0 tx=0x7f0de4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:25.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.099+0000 7f0dde7fc640 1 -- 172.21.15.40:0/2497863055 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0de0063b80 con 0x7f0de8150e30 2024-09-21T01:50:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.326+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0de8151410 con 0x7f0de8150e30 2024-09-21T01:50:25.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.948+0000 7f0dde7fc640 1 -- 172.21.15.40:0/2497863055 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f0de0063480 con 0x7f0de8150e30 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0dcc078bc0 msgr2=0x7f0dcc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0dcc078bc0 0x7f0dcc07b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0de40020a0 tx=0x7f0de4009040 comp rx=0 tx=0).stop 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8150e30 msgr2=0x7f0de81f8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8150e30 0x7f0de81f8a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e940 tx=0x7f0de000ee00 comp rx=0 tx=0).stop 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 shutdown_connections 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f0dcc078bc0 0x7f0dcc07b0d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8150e30 0x7f0de81f8a50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0de80d4c30 0x7f0de81508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 --2- 172.21.15.40:0/2497863055 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f0de80b3910 0x7f0de80cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:25.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 >> 172.21.15.40:0/2497863055 conn(0x7f0de809d830 msgr2=0x7f0de80b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:25.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 shutdown_connections 2024-09-21T01:50:25.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:25.951+0000 7f0df012b640 1 -- 172.21.15.40:0/2497863055 wait complete. 2024-09-21T01:50:25.965 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T01:50:25.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:50:26.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.089+0000 7efd4e6de640 1 -- 172.21.15.40:0/2435048816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd480b9970 msgr2=0x7efd480b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.089+0000 7efd4e6de640 1 --2- 172.21.15.40:0/2435048816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd480b9970 0x7efd480b3710 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efd38009910 tx=0x7efd3802a5f0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.089+0000 7efd4e6de640 1 -- 172.21.15.40:0/2435048816 shutdown_connections 2024-09-21T01:50:26.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.089+0000 7efd4e6de640 1 --2- 172.21.15.40:0/2435048816 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efd4806e0e0 0x7efd4806e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.089+0000 7efd4e6de640 1 --2- 172.21.15.40:0/2435048816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd480b9970 0x7efd480b3710 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.089+0000 7efd4e6de640 1 -- 172.21.15.40:0/2435048816 >> 172.21.15.40:0/2435048816 conn(0x7efd4809d7f0 msgr2=0x7efd480d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.089+0000 7efd4e6de640 1 -- 172.21.15.40:0/2435048816 shutdown_connections 2024-09-21T01:50:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.089+0000 7efd4e6de640 1 -- 172.21.15.40:0/2435048816 wait complete. 2024-09-21T01:50:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.091+0000 7efd4e6de640 1 Processor -- start 2024-09-21T01:50:26.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.091+0000 7efd4e6de640 1 -- start start 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.092+0000 7efd4e6de640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd4806e0e0 0x7efd4815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.092+0000 7efd4e6de640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efd480b5fa0 0x7efd480cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.092+0000 7efd4e6de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd480b9970 0x7efd480ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.092+0000 7efd4e6de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efd4806ea30 con 0x7efd480b9970 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.092+0000 7efd4e6de640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efd480d5010 con 0x7efd4806e0e0 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.092+0000 7efd4e6de640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7efd4806ebb0 con 0x7efd480b5fa0 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.092+0000 7efd4cc7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd480b9970 0x7efd480ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.092+0000 7efd4cc7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd480b9970 0x7efd480ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47552/0 (socket says 172.21.15.40:47552) 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.092+0000 7efd4cc7b640 1 -- 172.21.15.40:0/4096321237 learned_addr learned my addr 172.21.15.40:0/4096321237 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:26.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd47fff640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd4806e0e0 0x7efd4815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd477fe640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efd480b5fa0 0x7efd480cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd4cc7b640 1 -- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efd480b5fa0 msgr2=0x7efd480cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd4cc7b640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efd480b5fa0 0x7efd480cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd4cc7b640 1 -- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd4806e0e0 msgr2=0x7efd4815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd4cc7b640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd4806e0e0 0x7efd4815c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd4cc7b640 1 -- 172.21.15.40:0/4096321237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd481619c0 con 0x7efd480b9970 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd4cc7b640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd480b9970 0x7efd480ce3c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd4000ec20 tx=0x7efd4000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd44ff9640 1 -- 172.21.15.40:0/4096321237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40003b70 con 0x7efd480b9970 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd48161ca0 con 0x7efd480b9970 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd44ff9640 1 -- 172.21.15.40:0/4096321237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd40003e00 con 0x7efd480b9970 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd44ff9640 1 -- 172.21.15.40:0/4096321237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40004280 con 0x7efd480b9970 2024-09-21T01:50:26.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.093+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd48162260 con 0x7efd480b9970 2024-09-21T01:50:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.094+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd48160030 con 0x7efd480b9970 2024-09-21T01:50:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.095+0000 7efd44ff9640 1 -- 172.21.15.40:0/4096321237 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd40004420 con 0x7efd480b9970 2024-09-21T01:50:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.096+0000 7efd44ff9640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7efd34078b90 0x7efd3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.096+0000 7efd44ff9640 1 -- 172.21.15.40:0/4096321237 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7efd4009bc20 con 0x7efd480b9970 2024-09-21T01:50:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.096+0000 7efd47fff640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7efd34078b90 0x7efd3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.096+0000 7efd47fff640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7efd34078b90 0x7efd3407b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efd38034000 tx=0x7efd38004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:26.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.100+0000 7efd44ff9640 1 -- 172.21.15.40:0/4096321237 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efd40064060 con 0x7efd480b9970 2024-09-21T01:50:26.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.330+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd480d0aa0 con 0x7efd480b9970 2024-09-21T01:50:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.330+0000 7efd44ff9640 1 -- 172.21.15.40:0/4096321237 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5223 (secure 0 0 0) 0x7efd480d0aa0 con 0x7efd480b9970 2024-09-21T01:50:26.331 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:26.331 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"btime":"2024-09-21T01:50:25:944113+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/2199799930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2199799930},{"type":"v1","addr":"172.21.15.139:6836","nonce":2199799930}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/989261762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":989261762},{"type":"v1","addr":"172.21.15.139:6837","nonce":989261762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/452586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":452586017},{"type":"v1","addr":"172.21.15.40:6835","nonce":452586017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:50:22.334764+0000","modified":"2024-09-21T01:50:25.327599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2587661655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2587661655},{"type":"v1","addr":"172.21.15.40:6834","nonce":2587661655}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T01:50:26.331 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 17 2024-09-21T01:50:26.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7efd34078b90 msgr2=0x7efd3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7efd34078b90 0x7efd3407b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efd38034000 tx=0x7efd38004730 comp rx=0 tx=0).stop 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd480b9970 msgr2=0x7efd480ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd480b9970 0x7efd480ce3c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd4000ec20 tx=0x7efd4000c6a0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 shutdown_connections 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7efd34078b90 0x7efd3407b0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd480b9970 0x7efd480ce3c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7efd480b5fa0 0x7efd480cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 --2- 172.21.15.40:0/4096321237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd4806e0e0 0x7efd4815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 >> 172.21.15.40:0/4096321237 conn(0x7efd4809d7f0 msgr2=0x7efd480b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 shutdown_connections 2024-09-21T01:50:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.333+0000 7efd4e6de640 1 -- 172.21.15.40:0/4096321237 wait complete. 2024-09-21T01:50:26.345 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:50:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.460+0000 7f857cdc3640 1 -- 172.21.15.40:0/644192036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85780cc1e0 msgr2=0x7f85780af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.460+0000 7f857cdc3640 1 --2- 172.21.15.40:0/644192036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85780cc1e0 0x7f85780af3c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8578072dc0 tx=0x7f856802aac0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.460+0000 7f857cdc3640 1 -- 172.21.15.40:0/644192036 shutdown_connections 2024-09-21T01:50:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.460+0000 7f857cdc3640 1 --2- 172.21.15.40:0/644192036 >> v2:172.21.15.139:3300/0 conn(0x7f85780ccb50 0x7f85780ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.460+0000 7f857cdc3640 1 --2- 172.21.15.40:0/644192036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85780cc1e0 0x7f85780af3c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.460+0000 7f857cdc3640 1 -- 172.21.15.40:0/644192036 >> 172.21.15.40:0/644192036 conn(0x7f857806d7d0 msgr2=0x7f85780b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.460+0000 7f857cdc3640 1 -- 172.21.15.40:0/644192036 shutdown_connections 2024-09-21T01:50:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.460+0000 7f857cdc3640 1 -- 172.21.15.40:0/644192036 wait complete. 2024-09-21T01:50:26.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.462+0000 7f857cdc3640 1 Processor -- start 2024-09-21T01:50:26.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.462+0000 7f857cdc3640 1 -- start start 2024-09-21T01:50:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.463+0000 7f857cdc3640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85780cc1e0 0x7f857809c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.463+0000 7f857cdc3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85780ccb50 0x7f8578150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.463+0000 7f857cdc3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f857815d8a0 0x7f8578158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.463+0000 7f857cdc3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f85781533a0 con 0x7f857815d8a0 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.463+0000 7f857cdc3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8578153520 con 0x7f85780ccb50 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.463+0000 7f857cdc3640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f85781536a0 con 0x7f85780cc1e0 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8576d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f857815d8a0 0x7f8578158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8576d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f857815d8a0 0x7f8578158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47572/0 (socket says 172.21.15.40:47572) 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8576d9d640 1 -- 172.21.15.40:0/4131542378 learned_addr learned my addr 172.21.15.40:0/4131542378 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f857659c640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85780cc1e0 0x7f857809c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8575d9b640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85780ccb50 0x7f8578150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8576d9d640 1 -- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85780cc1e0 msgr2=0x7f857809c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8576d9d640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85780cc1e0 0x7f857809c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8576d9d640 1 -- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85780ccb50 msgr2=0x7f8578150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8576d9d640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85780ccb50 0x7f8578150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8576d9d640 1 -- 172.21.15.40:0/4131542378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85781f8240 con 0x7f857815d8a0 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8575d9b640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85780ccb50 0x7f8578150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f8576d9d640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f857815d8a0 0x7f8578158100 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f857000c8f0 tx=0x7f857000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f856effd640 1 -- 172.21.15.40:0/4131542378 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570007bb0 con 0x7f857815d8a0 2024-09-21T01:50:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f856effd640 1 -- 172.21.15.40:0/4131542378 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f857000ae40 con 0x7f857815d8a0 2024-09-21T01:50:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85781f3f60 con 0x7f857815d8a0 2024-09-21T01:50:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f856effd640 1 -- 172.21.15.40:0/4131542378 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570005280 con 0x7f857815d8a0 2024-09-21T01:50:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.464+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85781f4520 con 0x7f857815d8a0 2024-09-21T01:50:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.465+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f857809c780 con 0x7f857815d8a0 2024-09-21T01:50:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.466+0000 7f856effd640 1 -- 172.21.15.40:0/4131542378 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8570005420 con 0x7f857815d8a0 2024-09-21T01:50:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.467+0000 7f856effd640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8558078bc0 0x7f855807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.467+0000 7f856effd640 1 -- 172.21.15.40:0/4131542378 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f857009b4b0 con 0x7f857815d8a0 2024-09-21T01:50:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.467+0000 7f857659c640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8558078bc0 0x7f855807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.468+0000 7f857659c640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8558078bc0 0x7f855807b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8568035000 tx=0x7f8568004ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.471+0000 7f856effd640 1 -- 172.21.15.40:0/4131542378 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8570014030 con 0x7f857815d8a0 2024-09-21T01:50:26.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.661+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8578076820 con 0x7f857815d8a0 2024-09-21T01:50:26.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.662+0000 7f856effd640 1 -- 172.21.15.40:0/4131542378 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16741 (secure 0 0 0) 0x7f8578076820 con 0x7f857815d8a0 2024-09-21T01:50:26.663 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:26.663 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":32,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","created":"2024-09-21T01:49:14.897600+0000","modified":"2024-09-21T01:50:23.917384+0000","last_up_change":"2024-09-21T01:49:28.252238+0000","last_in_change":"2024-09-21T01:49:18.518417+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:49:27.357546+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:50:19.998609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T01:50:21.270421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b3d756bf-fe80-4681-a411-7c9c5836ac69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6825","nonce":238312773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6827","nonce":238312773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6831","nonce":238312773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":238312773},{"type":"v1","addr":"172.21.15.40:6829","nonce":238312773}]},"public_addr":"172.21.15.40:6825/238312773","cluster_addr":"172.21.15.40:6827/238312773","heartbeat_back_addr":"172.21.15.40:6831/238312773","heartbeat_front_addr":"172.21.15.40:6829/238312773","state":["exists","up"]},{"osd":1,"uuid":"fcc27a57-68ad-42d6-b808-1f1bea92ee09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6801","nonce":2884298880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6803","nonce":2884298880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6807","nonce":2884298880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2884298880},{"type":"v1","addr":"172.21.15.40:6805","nonce":2884298880}]},"public_addr":"172.21.15.40:6801/2884298880","cluster_addr":"172.21.15.40:6803/2884298880","heartbeat_back_addr":"172.21.15.40:6807/2884298880","heartbeat_front_addr":"172.21.15.40:6805/2884298880","state":["exists","up"]},{"osd":2,"uuid":"604e9c00-8c79-4707-8e14-d77ba3f49e2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6809","nonce":3415875567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6811","nonce":3415875567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6815","nonce":3415875567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3415875567},{"type":"v1","addr":"172.21.15.40:6813","nonce":3415875567}]},"public_addr":"172.21.15.40:6809/3415875567","cluster_addr":"172.21.15.40:6811/3415875567","heartbeat_back_addr":"172.21.15.40:6815/3415875567","heartbeat_front_addr":"172.21.15.40:6813/3415875567","state":["exists","up"]},{"osd":3,"uuid":"c9691d72-0da9-4ad5-ac26-2db91337ba9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6817","nonce":3104901496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6819","nonce":3104901496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6823","nonce":3104901496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3104901496},{"type":"v1","addr":"172.21.15.40:6821","nonce":3104901496}]},"public_addr":"172.21.15.40:6817/3104901496","cluster_addr":"172.21.15.40:6819/3104901496","heartbeat_back_addr":"172.21.15.40:6823/3104901496","heartbeat_front_addr":"172.21.15.40:6821/3104901496","state":["exists","up"]},{"osd":4,"uuid":"ae12cfd7-d19f-4b0f-9440-c50dc65d7a0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6811","nonce":3827934146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6813","nonce":3827934146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6817","nonce":3827934146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":3827934146},{"type":"v1","addr":"172.21.15.139:6815","nonce":3827934146}]},"public_addr":"172.21.15.139:6811/3827934146","cluster_addr":"172.21.15.139:6813/3827934146","heartbeat_back_addr":"172.21.15.139:6817/3827934146","heartbeat_front_addr":"172.21.15.139:6815/3827934146","state":["exists","up"]},{"osd":5,"uuid":"e80ec918-dee3-44b5-823f-7c9010e4510d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6819","nonce":3013227265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6821","nonce":3013227265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6825","nonce":3013227265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3013227265},{"type":"v1","addr":"172.21.15.139:6823","nonce":3013227265}]},"public_addr":"172.21.15.139:6819/3013227265","cluster_addr":"172.21.15.139:6821/3013227265","heartbeat_back_addr":"172.21.15.139:6825/3013227265","heartbeat_front_addr":"172.21.15.139:6823/3013227265","state":["exists","up"]},{"osd":6,"uuid":"b95f7195-e3bd-4af7-8074-c13a6e73c387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6803","nonce":1976010004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6805","nonce":1976010004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6809","nonce":1976010004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1976010004},{"type":"v1","addr":"172.21.15.139:6807","nonce":1976010004}]},"public_addr":"172.21.15.139:6803/1976010004","cluster_addr":"172.21.15.139:6805/1976010004","heartbeat_back_addr":"172.21.15.139:6809/1976010004","heartbeat_front_addr":"172.21.15.139:6807/1976010004","state":["exists","up"]},{"osd":7,"uuid":"37b2f54f-005a-4a5a-92bd-52c5e8f1ec30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6827","nonce":2324338989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6829","nonce":2324338989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6833","nonce":2324338989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2324338989},{"type":"v1","addr":"172.21.15.139:6831","nonce":2324338989}]},"public_addr":"172.21.15.139:6827/2324338989","cluster_addr":"172.21.15.139:6829/2324338989","heartbeat_back_addr":"172.21.15.139:6833/2324338989","heartbeat_front_addr":"172.21.15.139:6831/2324338989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.044622+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.547852+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:24.561624+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.497373+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.641109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.247273+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.373654+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:49:25.609265+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8558078bc0 msgr2=0x7f855807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8558078bc0 0x7f855807b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8568035000 tx=0x7f8568004ab0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f857815d8a0 msgr2=0x7f8578158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f857815d8a0 0x7f8578158100 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f857000c8f0 tx=0x7f857000cdb0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 shutdown_connections 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f8558078bc0 0x7f855807b0d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f857815d8a0 0x7f8578158100 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85780ccb50 0x7f8578150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 --2- 172.21.15.40:0/4131542378 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f85780cc1e0 0x7f857809c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 >> 172.21.15.40:0/4131542378 conn(0x7f857806d7d0 msgr2=0x7f85780b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 shutdown_connections 2024-09-21T01:50:26.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.665+0000 7f857cdc3640 1 -- 172.21.15.40:0/4131542378 wait complete. 2024-09-21T01:50:26.677 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T01:50:26.677 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:50:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.792+0000 7f6613069640 1 -- 172.21.15.40:0/1421052213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c0d0e50 msgr2=0x7f660c0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.792+0000 7f6613069640 1 --2- 172.21.15.40:0/1421052213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c0d0e50 0x7f660c0d1260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6604005fd0 tx=0x7f660402a980 comp rx=0 tx=0).stop 2024-09-21T01:50:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.792+0000 7f6613069640 1 -- 172.21.15.40:0/1421052213 shutdown_connections 2024-09-21T01:50:26.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.792+0000 7f6613069640 1 --2- 172.21.15.40:0/1421052213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c0d0e50 0x7f660c0d1260 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.792+0000 7f6613069640 1 --2- 172.21.15.40:0/1421052213 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f660c0b97e0 0x7f660c06f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.792+0000 7f6613069640 1 -- 172.21.15.40:0/1421052213 >> 172.21.15.40:0/1421052213 conn(0x7f660c09d840 msgr2=0x7f660c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:26.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.792+0000 7f6613069640 1 -- 172.21.15.40:0/1421052213 shutdown_connections 2024-09-21T01:50:26.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.792+0000 7f6613069640 1 -- 172.21.15.40:0/1421052213 wait complete. 2024-09-21T01:50:26.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.794+0000 7f6613069640 1 Processor -- start 2024-09-21T01:50:26.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.794+0000 7f6613069640 1 -- start start 2024-09-21T01:50:26.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6613069640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c06e0a0 0x7f660c1eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6613069640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f660c0b97e0 0x7f660c0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6613069640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f660c0d0e50 0x7f660c1f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6613069640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f660c0cfea0 con 0x7f660c06e0a0 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6613069640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f660c0cfd20 con 0x7f660c0b97e0 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6613069640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f660c0d0020 con 0x7f660c0d0e50 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6610e05640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c06e0a0 0x7f660c1eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6610e05640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c06e0a0 0x7f660c1eacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47604/0 (socket says 172.21.15.40:47604) 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6610e05640 1 -- 172.21.15.40:0/3547683533 learned_addr learned my addr 172.21.15.40:0/3547683533 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f660bfff640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f660c0b97e0 0x7f660c0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6611606640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f660c0d0e50 0x7f660c1f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6610e05640 1 -- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f660c0d0e50 msgr2=0x7f660c1f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6610e05640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f660c0d0e50 0x7f660c1f8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6610e05640 1 -- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f660c0b97e0 msgr2=0x7f660c0ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6610e05640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f660c0b97e0 0x7f660c0ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6610e05640 1 -- 172.21.15.40:0/3547683533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c150b50 con 0x7f660c06e0a0 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f660bfff640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f660c0b97e0 0x7f660c0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6611606640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f660c0d0e50 0x7f660c1f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.796+0000 7f6610e05640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c06e0a0 0x7f660c1eacd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f660000c390 tx=0x7f660000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.797+0000 7f66097fa640 1 -- 172.21.15.40:0/3547683533 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600017070 con 0x7f660c06e0a0 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.797+0000 7f66097fa640 1 -- 172.21.15.40:0/3547683533 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66000035f0 con 0x7f660c06e0a0 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.797+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660c150e30 con 0x7f660c06e0a0 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.797+0000 7f66097fa640 1 -- 172.21.15.40:0/3547683533 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600003a20 con 0x7f660c06e0a0 2024-09-21T01:50:26.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.797+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660c1513f0 con 0x7f660c06e0a0 2024-09-21T01:50:26.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.798+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660c0d39a0 con 0x7f660c06e0a0 2024-09-21T01:50:26.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.798+0000 7f66097fa640 1 -- 172.21.15.40:0/3547683533 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f660001a070 con 0x7f660c06e0a0 2024-09-21T01:50:26.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.799+0000 7f66097fa640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f65f0078b90 0x7f65f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:26.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.799+0000 7f66097fa640 1 -- 172.21.15.40:0/3547683533 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f660009a020 con 0x7f660c06e0a0 2024-09-21T01:50:26.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.799+0000 7f660bfff640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f65f0078b90 0x7f65f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:26.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.800+0000 7f660bfff640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f65f0078b90 0x7f65f007b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65f8005fd0 tx=0x7f65f800f360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:26.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.804+0000 7f66097fa640 1 -- 172.21.15.40:0/3547683533 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f660c0d39a0 con 0x7f660c06e0a0 2024-09-21T01:50:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.990+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 --> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f660c069a50 con 0x7f65f0078b90 2024-09-21T01:50:26.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.996+0000 7f66097fa640 1 -- 172.21.15.40:0/3547683533 <== mgr.4100 v2:172.21.15.139:6800/852736644 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251933 (secure 0 0 0) 0x7f660c069a50 con 0x7f65f0078b90 2024-09-21T01:50:26.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:27.000 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f65f0078b90 msgr2=0x7f65f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f65f0078b90 0x7f65f007b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65f8005fd0 tx=0x7f65f800f360 comp rx=0 tx=0).stop 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c06e0a0 msgr2=0x7f660c1eacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c06e0a0 0x7f660c1eacd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f660000c390 tx=0x7f660000c850 comp rx=0 tx=0).stop 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 shutdown_connections 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f65f0078b90 0x7f65f007b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f660c0d0e50 0x7f660c1f8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f660c0b97e0 0x7f660c0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 --2- 172.21.15.40:0/3547683533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f660c06e0a0 0x7f660c1eacd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 >> 172.21.15.40:0/3547683533 conn(0x7f660c09d840 msgr2=0x7f660c0b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:27.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 shutdown_connections 2024-09-21T01:50:27.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:26.999+0000 7f6613069640 1 -- 172.21.15.40:0/3547683533 wait complete. 2024-09-21T01:50:27.011 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-21T01:50:25.320883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220092,"kb_used_data":3836,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754628,"statfs":{"total":773094113280,"available":772868739072,"internally_reserved":0,"allocated":3928064,"data_stored":2201174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.408478"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944969+0000","last_change":"2024-09-21T01:50:22.938230+0000","last_active":"2024-09-21T01:50:23.944969+0000","last_peered":"2024-09-21T01:50:23.944969+0000","last_clean":"2024-09-21T01:50:23.944969+0000","last_became_active":"2024-09-21T01:50:22.937879+0000","last_became_peered":"2024-09-21T01:50:22.937879+0000","last_unstale":"2024-09-21T01:50:23.944969+0000","last_undegraded":"2024-09-21T01:50:23.944969+0000","last_fullsized":"2024-09-21T01:50:23.944969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:15.679550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922905+0000","last_change":"2024-09-21T01:50:22.938036+0000","last_active":"2024-09-21T01:50:23.922905+0000","last_peered":"2024-09-21T01:50:23.922905+0000","last_clean":"2024-09-21T01:50:23.922905+0000","last_became_active":"2024-09-21T01:50:22.937728+0000","last_became_peered":"2024-09-21T01:50:22.937728+0000","last_unstale":"2024-09-21T01:50:23.922905+0000","last_undegraded":"2024-09-21T01:50:23.922905+0000","last_fullsized":"2024-09-21T01:50:23.922905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:19.587920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945285+0000","last_change":"2024-09-21T01:50:22.949179+0000","last_active":"2024-09-21T01:50:23.945285+0000","last_peered":"2024-09-21T01:50:23.945285+0000","last_clean":"2024-09-21T01:50:23.945285+0000","last_became_active":"2024-09-21T01:50:22.948846+0000","last_became_peered":"2024-09-21T01:50:22.948846+0000","last_unstale":"2024-09-21T01:50:23.945285+0000","last_undegraded":"2024-09-21T01:50:23.945285+0000","last_fullsized":"2024-09-21T01:50:23.945285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:30.303028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.941895+0000","last_change":"2024-09-21T01:50:22.935589+0000","last_active":"2024-09-21T01:50:22.941895+0000","last_peered":"2024-09-21T01:50:22.941895+0000","last_clean":"2024-09-21T01:50:22.941895+0000","last_became_active":"2024-09-21T01:50:22.934379+0000","last_became_peered":"2024-09-21T01:50:22.934379+0000","last_unstale":"2024-09-21T01:50:22.941895+0000","last_undegraded":"2024-09-21T01:50:22.941895+0000","last_fullsized":"2024-09-21T01:50:22.941895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:45.807548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938245+0000","last_change":"2024-09-21T01:50:22.934017+0000","last_active":"2024-09-21T01:50:22.938245+0000","last_peered":"2024-09-21T01:50:22.938245+0000","last_clean":"2024-09-21T01:50:22.938245+0000","last_became_active":"2024-09-21T01:50:22.933647+0000","last_became_peered":"2024-09-21T01:50:22.933647+0000","last_unstale":"2024-09-21T01:50:22.938245+0000","last_undegraded":"2024-09-21T01:50:22.938245+0000","last_fullsized":"2024-09-21T01:50:22.938245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:28.024099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922614+0000","last_change":"2024-09-21T01:50:22.930225+0000","last_active":"2024-09-21T01:50:23.922614+0000","last_peered":"2024-09-21T01:50:23.922614+0000","last_clean":"2024-09-21T01:50:23.922614+0000","last_became_active":"2024-09-21T01:50:22.929889+0000","last_became_peered":"2024-09-21T01:50:22.929889+0000","last_unstale":"2024-09-21T01:50:23.922614+0000","last_undegraded":"2024-09-21T01:50:23.922614+0000","last_fullsized":"2024-09-21T01:50:23.922614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:22.861515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944242+0000","last_change":"2024-09-21T01:50:22.945792+0000","last_active":"2024-09-21T01:50:23.944242+0000","last_peered":"2024-09-21T01:50:23.944242+0000","last_clean":"2024-09-21T01:50:23.944242+0000","last_became_active":"2024-09-21T01:50:22.945488+0000","last_became_peered":"2024-09-21T01:50:22.945488+0000","last_unstale":"2024-09-21T01:50:23.944242+0000","last_undegraded":"2024-09-21T01:50:23.944242+0000","last_fullsized":"2024-09-21T01:50:23.944242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:29:51.340786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943528+0000","last_change":"2024-09-21T01:50:22.938825+0000","last_active":"2024-09-21T01:50:23.943528+0000","last_peered":"2024-09-21T01:50:23.943528+0000","last_clean":"2024-09-21T01:50:23.943528+0000","last_became_active":"2024-09-21T01:50:22.938530+0000","last_became_peered":"2024-09-21T01:50:22.938530+0000","last_unstale":"2024-09-21T01:50:23.943528+0000","last_undegraded":"2024-09-21T01:50:23.943528+0000","last_fullsized":"2024-09-21T01:50:23.943528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:27.851164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922734+0000","last_change":"2024-09-21T01:50:22.932459+0000","last_active":"2024-09-21T01:50:23.922734+0000","last_peered":"2024-09-21T01:50:23.922734+0000","last_clean":"2024-09-21T01:50:23.922734+0000","last_became_active":"2024-09-21T01:50:22.932098+0000","last_became_peered":"2024-09-21T01:50:22.932098+0000","last_unstale":"2024-09-21T01:50:23.922734+0000","last_undegraded":"2024-09-21T01:50:23.922734+0000","last_fullsized":"2024-09-21T01:50:23.922734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:12.461898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.941773+0000","last_change":"2024-09-21T01:50:22.934659+0000","last_active":"2024-09-21T01:50:22.941773+0000","last_peered":"2024-09-21T01:50:22.941773+0000","last_clean":"2024-09-21T01:50:22.941773+0000","last_became_active":"2024-09-21T01:50:22.934310+0000","last_became_peered":"2024-09-21T01:50:22.934310+0000","last_unstale":"2024-09-21T01:50:22.941773+0000","last_undegraded":"2024-09-21T01:50:22.941773+0000","last_fullsized":"2024-09-21T01:50:22.941773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:52.913208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943883+0000","last_change":"2024-09-21T01:50:22.948538+0000","last_active":"2024-09-21T01:50:23.943883+0000","last_peered":"2024-09-21T01:50:23.943883+0000","last_clean":"2024-09-21T01:50:23.943883+0000","last_became_active":"2024-09-21T01:50:22.948219+0000","last_became_peered":"2024-09-21T01:50:22.948219+0000","last_unstale":"2024-09-21T01:50:23.943883+0000","last_undegraded":"2024-09-21T01:50:23.943883+0000","last_fullsized":"2024-09-21T01:50:23.943883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:03.184965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945915+0000","last_change":"2024-09-21T01:50:22.933672+0000","last_active":"2024-09-21T01:50:23.945915+0000","last_peered":"2024-09-21T01:50:23.945915+0000","last_clean":"2024-09-21T01:50:23.945915+0000","last_became_active":"2024-09-21T01:50:22.933307+0000","last_became_peered":"2024-09-21T01:50:22.933307+0000","last_unstale":"2024-09-21T01:50:23.945915+0000","last_undegraded":"2024-09-21T01:50:23.945915+0000","last_fullsized":"2024-09-21T01:50:23.945915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:08.575412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.946779+0000","last_change":"2024-09-21T01:50:22.945718+0000","last_active":"2024-09-21T01:50:22.946779+0000","last_peered":"2024-09-21T01:50:22.946779+0000","last_clean":"2024-09-21T01:50:22.946779+0000","last_became_active":"2024-09-21T01:50:22.945375+0000","last_became_peered":"2024-09-21T01:50:22.945375+0000","last_unstale":"2024-09-21T01:50:22.946779+0000","last_undegraded":"2024-09-21T01:50:22.946779+0000","last_fullsized":"2024-09-21T01:50:22.946779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:01.180944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922843+0000","last_change":"2024-09-21T01:50:22.939076+0000","last_active":"2024-09-21T01:50:23.922843+0000","last_peered":"2024-09-21T01:50:23.922843+0000","last_clean":"2024-09-21T01:50:23.922843+0000","last_became_active":"2024-09-21T01:50:22.938203+0000","last_became_peered":"2024-09-21T01:50:22.938203+0000","last_unstale":"2024-09-21T01:50:23.922843+0000","last_undegraded":"2024-09-21T01:50:23.922843+0000","last_fullsized":"2024-09-21T01:50:23.922843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:52.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945501+0000","last_change":"2024-09-21T01:50:22.940169+0000","last_active":"2024-09-21T01:50:23.945501+0000","last_peered":"2024-09-21T01:50:23.945501+0000","last_clean":"2024-09-21T01:50:23.945501+0000","last_became_active":"2024-09-21T01:50:22.939821+0000","last_became_peered":"2024-09-21T01:50:22.939821+0000","last_unstale":"2024-09-21T01:50:23.945501+0000","last_undegraded":"2024-09-21T01:50:23.945501+0000","last_fullsized":"2024-09-21T01:50:23.945501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:46.768635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944492+0000","last_change":"2024-09-21T01:50:22.949851+0000","last_active":"2024-09-21T01:50:23.944492+0000","last_peered":"2024-09-21T01:50:23.944492+0000","last_clean":"2024-09-21T01:50:23.944492+0000","last_became_active":"2024-09-21T01:50:22.949535+0000","last_became_peered":"2024-09-21T01:50:22.949535+0000","last_unstale":"2024-09-21T01:50:23.944492+0000","last_undegraded":"2024-09-21T01:50:23.944492+0000","last_fullsized":"2024-09-21T01:50:23.944492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:18.494639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944394+0000","last_change":"2024-09-21T01:50:22.951560+0000","last_active":"2024-09-21T01:50:23.944394+0000","last_peered":"2024-09-21T01:50:23.944394+0000","last_clean":"2024-09-21T01:50:23.944394+0000","last_became_active":"2024-09-21T01:50:22.951172+0000","last_became_peered":"2024-09-21T01:50:22.951172+0000","last_unstale":"2024-09-21T01:50:23.944394+0000","last_undegraded":"2024-09-21T01:50:23.944394+0000","last_fullsized":"2024-09-21T01:50:23.944394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:08.575412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923132+0000","last_change":"2024-09-21T01:50:22.937120+0000","last_active":"2024-09-21T01:50:23.923132+0000","last_peered":"2024-09-21T01:50:23.923132+0000","last_clean":"2024-09-21T01:50:23.923132+0000","last_became_active":"2024-09-21T01:50:22.936701+0000","last_became_peered":"2024-09-21T01:50:22.936701+0000","last_unstale":"2024-09-21T01:50:23.923132+0000","last_undegraded":"2024-09-21T01:50:23.923132+0000","last_fullsized":"2024-09-21T01:50:23.923132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:08.806012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922424+0000","last_change":"2024-09-21T01:50:22.938015+0000","last_active":"2024-09-21T01:50:23.922424+0000","last_peered":"2024-09-21T01:50:23.922424+0000","last_clean":"2024-09-21T01:50:23.922424+0000","last_became_active":"2024-09-21T01:50:22.937610+0000","last_became_peered":"2024-09-21T01:50:22.937610+0000","last_unstale":"2024-09-21T01:50:23.922424+0000","last_undegraded":"2024-09-21T01:50:23.922424+0000","last_fullsized":"2024-09-21T01:50:23.922424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:08.575412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938579+0000","last_change":"2024-09-21T01:50:22.934043+0000","last_active":"2024-09-21T01:50:22.938579+0000","last_peered":"2024-09-21T01:50:22.938579+0000","last_clean":"2024-09-21T01:50:22.938579+0000","last_became_active":"2024-09-21T01:50:22.933593+0000","last_became_peered":"2024-09-21T01:50:22.933593+0000","last_unstale":"2024-09-21T01:50:22.938579+0000","last_undegraded":"2024-09-21T01:50:22.938579+0000","last_fullsized":"2024-09-21T01:50:22.938579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:15.390413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922928+0000","last_change":"2024-09-21T01:50:22.942951+0000","last_active":"2024-09-21T01:50:23.922928+0000","last_peered":"2024-09-21T01:50:23.922928+0000","last_clean":"2024-09-21T01:50:23.922928+0000","last_became_active":"2024-09-21T01:50:22.942650+0000","last_became_peered":"2024-09-21T01:50:22.942650+0000","last_unstale":"2024-09-21T01:50:23.922928+0000","last_undegraded":"2024-09-21T01:50:23.922928+0000","last_fullsized":"2024-09-21T01:50:23.922928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:51.759417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922749+0000","last_change":"2024-09-21T01:50:22.934555+0000","last_active":"2024-09-21T01:50:23.922749+0000","last_peered":"2024-09-21T01:50:23.922749+0000","last_clean":"2024-09-21T01:50:23.922749+0000","last_became_active":"2024-09-21T01:50:22.934206+0000","last_became_peered":"2024-09-21T01:50:22.934206+0000","last_unstale":"2024-09-21T01:50:23.922749+0000","last_undegraded":"2024-09-21T01:50:23.922749+0000","last_fullsized":"2024-09-21T01:50:23.922749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:35.229566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943023+0000","last_change":"2024-09-21T01:50:22.947386+0000","last_active":"2024-09-21T01:50:23.943023+0000","last_peered":"2024-09-21T01:50:23.943023+0000","last_clean":"2024-09-21T01:50:23.943023+0000","last_became_active":"2024-09-21T01:50:22.947038+0000","last_became_peered":"2024-09-21T01:50:22.947038+0000","last_unstale":"2024-09-21T01:50:23.943023+0000","last_undegraded":"2024-09-21T01:50:23.943023+0000","last_fullsized":"2024-09-21T01:50:23.943023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:35.229566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945600+0000","last_change":"2024-09-21T01:50:22.936259+0000","last_active":"2024-09-21T01:50:23.945600+0000","last_peered":"2024-09-21T01:50:23.945600+0000","last_clean":"2024-09-21T01:50:23.945600+0000","last_became_active":"2024-09-21T01:50:22.935034+0000","last_became_peered":"2024-09-21T01:50:22.935034+0000","last_unstale":"2024-09-21T01:50:23.945600+0000","last_undegraded":"2024-09-21T01:50:23.945600+0000","last_fullsized":"2024-09-21T01:50:23.945600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:29:51.340786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.952354+0000","last_change":"2024-09-21T01:50:22.940999+0000","last_active":"2024-09-21T01:50:22.952354+0000","last_peered":"2024-09-21T01:50:22.952354+0000","last_clean":"2024-09-21T01:50:22.952354+0000","last_became_active":"2024-09-21T01:50:22.940703+0000","last_became_peered":"2024-09-21T01:50:22.940703+0000","last_unstale":"2024-09-21T01:50:22.952354+0000","last_undegraded":"2024-09-21T01:50:22.952354+0000","last_fullsized":"2024-09-21T01:50:22.952354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:45.686951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923272+0000","last_change":"2024-09-21T01:50:22.934969+0000","last_active":"2024-09-21T01:50:23.923272+0000","last_peered":"2024-09-21T01:50:23.923272+0000","last_clean":"2024-09-21T01:50:23.923272+0000","last_became_active":"2024-09-21T01:50:22.934597+0000","last_became_peered":"2024-09-21T01:50:22.934597+0000","last_unstale":"2024-09-21T01:50:23.923272+0000","last_undegraded":"2024-09-21T01:50:23.923272+0000","last_fullsized":"2024-09-21T01:50:23.923272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:02.635600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938540+0000","last_change":"2024-09-21T01:50:22.928871+0000","last_active":"2024-09-21T01:50:22.938540+0000","last_peered":"2024-09-21T01:50:22.938540+0000","last_clean":"2024-09-21T01:50:22.938540+0000","last_became_active":"2024-09-21T01:50:22.928542+0000","last_became_peered":"2024-09-21T01:50:22.928542+0000","last_unstale":"2024-09-21T01:50:22.938540+0000","last_undegraded":"2024-09-21T01:50:22.938540+0000","last_fullsized":"2024-09-21T01:50:22.938540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:13.451577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.946130+0000","last_change":"2024-09-21T01:50:22.935884+0000","last_active":"2024-09-21T01:50:23.946130+0000","last_peered":"2024-09-21T01:50:23.946130+0000","last_clean":"2024-09-21T01:50:23.946130+0000","last_became_active":"2024-09-21T01:50:22.935168+0000","last_became_peered":"2024-09-21T01:50:22.935168+0000","last_unstale":"2024-09-21T01:50:23.946130+0000","last_undegraded":"2024-09-21T01:50:23.946130+0000","last_fullsized":"2024-09-21T01:50:23.946130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:18.494639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922979+0000","last_change":"2024-09-21T01:50:22.935052+0000","last_active":"2024-09-21T01:50:23.922979+0000","last_peered":"2024-09-21T01:50:23.922979+0000","last_clean":"2024-09-21T01:50:23.922979+0000","last_became_active":"2024-09-21T01:50:22.934726+0000","last_became_peered":"2024-09-21T01:50:22.934726+0000","last_unstale":"2024-09-21T01:50:23.922979+0000","last_undegraded":"2024-09-21T01:50:23.922979+0000","last_fullsized":"2024-09-21T01:50:23.922979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:10.203132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943608+0000","last_change":"2024-09-21T01:50:22.943896+0000","last_active":"2024-09-21T01:50:23.943608+0000","last_peered":"2024-09-21T01:50:23.943608+0000","last_clean":"2024-09-21T01:50:23.943608+0000","last_became_active":"2024-09-21T01:50:22.943555+0000","last_became_peered":"2024-09-21T01:50:22.943555+0000","last_unstale":"2024-09-21T01:50:23.943608+0000","last_undegraded":"2024-09-21T01:50:23.943608+0000","last_fullsized":"2024-09-21T01:50:23.943608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:14.279845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944480+0000","last_change":"2024-09-21T01:50:22.944171+0000","last_active":"2024-09-21T01:50:23.944480+0000","last_peered":"2024-09-21T01:50:23.944480+0000","last_clean":"2024-09-21T01:50:23.944480+0000","last_became_active":"2024-09-21T01:50:22.943838+0000","last_became_peered":"2024-09-21T01:50:22.943838+0000","last_unstale":"2024-09-21T01:50:23.944480+0000","last_undegraded":"2024-09-21T01:50:23.944480+0000","last_fullsized":"2024-09-21T01:50:23.944480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.885742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943879+0000","last_change":"2024-09-21T01:50:22.943091+0000","last_active":"2024-09-21T01:50:23.943879+0000","last_peered":"2024-09-21T01:50:23.943879+0000","last_clean":"2024-09-21T01:50:23.943879+0000","last_became_active":"2024-09-21T01:50:22.942687+0000","last_became_peered":"2024-09-21T01:50:22.942687+0000","last_unstale":"2024-09-21T01:50:23.943879+0000","last_undegraded":"2024-09-21T01:50:23.943879+0000","last_fullsized":"2024-09-21T01:50:23.943879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:13.743137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.942884+0000","last_change":"2024-09-21T01:50:22.945935+0000","last_active":"2024-09-21T01:50:23.942884+0000","last_peered":"2024-09-21T01:50:23.942884+0000","last_clean":"2024-09-21T01:50:23.942884+0000","last_became_active":"2024-09-21T01:50:22.945643+0000","last_became_peered":"2024-09-21T01:50:22.945643+0000","last_unstale":"2024-09-21T01:50:23.942884+0000","last_undegraded":"2024-09-21T01:50:23.942884+0000","last_fullsized":"2024-09-21T01:50:23.942884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:15.775801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945104+0000","last_change":"2024-09-21T01:50:21.936573+0000","last_active":"2024-09-21T01:50:23.945104+0000","last_peered":"2024-09-21T01:50:23.945104+0000","last_clean":"2024-09-21T01:50:23.945104+0000","last_became_active":"2024-09-21T01:50:21.936223+0000","last_became_peered":"2024-09-21T01:50:21.936223+0000","last_unstale":"2024-09-21T01:50:23.945104+0000","last_undegraded":"2024-09-21T01:50:23.945104+0000","last_fullsized":"2024-09-21T01:50:23.945104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:56.999151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944705+0000","last_change":"2024-09-21T01:50:22.945483+0000","last_active":"2024-09-21T01:50:23.944705+0000","last_peered":"2024-09-21T01:50:23.944705+0000","last_clean":"2024-09-21T01:50:23.944705+0000","last_became_active":"2024-09-21T01:50:22.945151+0000","last_became_peered":"2024-09-21T01:50:22.945151+0000","last_unstale":"2024-09-21T01:50:23.944705+0000","last_undegraded":"2024-09-21T01:50:23.944705+0000","last_fullsized":"2024-09-21T01:50:23.944705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:57.762046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943041+0000","last_change":"2024-09-21T01:50:21.939207+0000","last_active":"2024-09-21T01:50:23.943041+0000","last_peered":"2024-09-21T01:50:23.943041+0000","last_clean":"2024-09-21T01:50:23.943041+0000","last_became_active":"2024-09-21T01:50:21.937960+0000","last_became_peered":"2024-09-21T01:50:21.937960+0000","last_unstale":"2024-09-21T01:50:23.943041+0000","last_undegraded":"2024-09-21T01:50:23.943041+0000","last_fullsized":"2024-09-21T01:50:23.943041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:24.984117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922701+0000","last_change":"2024-09-21T01:50:22.937135+0000","last_active":"2024-09-21T01:50:23.922701+0000","last_peered":"2024-09-21T01:50:23.922701+0000","last_clean":"2024-09-21T01:50:23.922701+0000","last_became_active":"2024-09-21T01:50:22.936716+0000","last_became_peered":"2024-09-21T01:50:22.936716+0000","last_unstale":"2024-09-21T01:50:23.922701+0000","last_undegraded":"2024-09-21T01:50:23.922701+0000","last_fullsized":"2024-09-21T01:50:23.922701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:34.041532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922557+0000","last_change":"2024-09-21T01:50:21.940591+0000","last_active":"2024-09-21T01:50:23.922557+0000","last_peered":"2024-09-21T01:50:23.922557+0000","last_clean":"2024-09-21T01:50:23.922557+0000","last_became_active":"2024-09-21T01:50:21.940115+0000","last_became_peered":"2024-09-21T01:50:21.940115+0000","last_unstale":"2024-09-21T01:50:23.922557+0000","last_undegraded":"2024-09-21T01:50:23.922557+0000","last_fullsized":"2024-09-21T01:50:23.922557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:06.862534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.943518+0000","last_change":"2024-09-21T01:50:22.936600+0000","last_active":"2024-09-21T01:50:22.943518+0000","last_peered":"2024-09-21T01:50:22.943518+0000","last_clean":"2024-09-21T01:50:22.943518+0000","last_became_active":"2024-09-21T01:50:22.936304+0000","last_became_peered":"2024-09-21T01:50:22.936304+0000","last_unstale":"2024-09-21T01:50:22.943518+0000","last_undegraded":"2024-09-21T01:50:22.943518+0000","last_fullsized":"2024-09-21T01:50:22.943518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:30.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.948639+0000","last_change":"2024-09-21T01:50:21.932948+0000","last_active":"2024-09-21T01:50:22.948639+0000","last_peered":"2024-09-21T01:50:22.948639+0000","last_clean":"2024-09-21T01:50:22.948639+0000","last_became_active":"2024-09-21T01:50:21.932602+0000","last_became_peered":"2024-09-21T01:50:21.932602+0000","last_unstale":"2024-09-21T01:50:22.948639+0000","last_undegraded":"2024-09-21T01:50:22.948639+0000","last_fullsized":"2024-09-21T01:50:22.948639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:11.710237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943871+0000","last_change":"2024-09-21T01:50:22.934501+0000","last_active":"2024-09-21T01:50:23.943871+0000","last_peered":"2024-09-21T01:50:23.943871+0000","last_clean":"2024-09-21T01:50:23.943871+0000","last_became_active":"2024-09-21T01:50:22.934137+0000","last_became_peered":"2024-09-21T01:50:22.934137+0000","last_unstale":"2024-09-21T01:50:23.943871+0000","last_undegraded":"2024-09-21T01:50:23.943871+0000","last_fullsized":"2024-09-21T01:50:23.943871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:08.211941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923011+0000","last_change":"2024-09-21T01:50:21.935872+0000","last_active":"2024-09-21T01:50:23.923011+0000","last_peered":"2024-09-21T01:50:23.923011+0000","last_clean":"2024-09-21T01:50:23.923011+0000","last_became_active":"2024-09-21T01:50:21.935504+0000","last_became_peered":"2024-09-21T01:50:21.935504+0000","last_unstale":"2024-09-21T01:50:23.923011+0000","last_undegraded":"2024-09-21T01:50:23.923011+0000","last_fullsized":"2024-09-21T01:50:23.923011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:22.095398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945068+0000","last_change":"2024-09-21T01:50:22.942334+0000","last_active":"2024-09-21T01:50:23.945068+0000","last_peered":"2024-09-21T01:50:23.945068+0000","last_clean":"2024-09-21T01:50:23.945068+0000","last_became_active":"2024-09-21T01:50:22.942004+0000","last_became_peered":"2024-09-21T01:50:22.942004+0000","last_unstale":"2024-09-21T01:50:23.945068+0000","last_undegraded":"2024-09-21T01:50:23.945068+0000","last_fullsized":"2024-09-21T01:50:23.945068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:08.211941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922288+0000","last_change":"2024-09-21T01:50:21.935949+0000","last_active":"2024-09-21T01:50:23.922288+0000","last_peered":"2024-09-21T01:50:23.922288+0000","last_clean":"2024-09-21T01:50:23.922288+0000","last_became_active":"2024-09-21T01:50:21.935631+0000","last_became_peered":"2024-09-21T01:50:21.935631+0000","last_unstale":"2024-09-21T01:50:23.922288+0000","last_undegraded":"2024-09-21T01:50:23.922288+0000","last_fullsized":"2024-09-21T01:50:23.922288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:33.747031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922520+0000","last_change":"2024-09-21T01:50:22.937250+0000","last_active":"2024-09-21T01:50:23.922520+0000","last_peered":"2024-09-21T01:50:23.922520+0000","last_clean":"2024-09-21T01:50:23.922520+0000","last_became_active":"2024-09-21T01:50:22.936716+0000","last_became_peered":"2024-09-21T01:50:22.936716+0000","last_unstale":"2024-09-21T01:50:23.922520+0000","last_undegraded":"2024-09-21T01:50:23.922520+0000","last_fullsized":"2024-09-21T01:50:23.922520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:57.762046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922441+0000","last_change":"2024-09-21T01:50:21.933985+0000","last_active":"2024-09-21T01:50:23.922441+0000","last_peered":"2024-09-21T01:50:23.922441+0000","last_clean":"2024-09-21T01:50:23.922441+0000","last_became_active":"2024-09-21T01:50:21.933607+0000","last_became_peered":"2024-09-21T01:50:21.933607+0000","last_unstale":"2024-09-21T01:50:23.922441+0000","last_undegraded":"2024-09-21T01:50:23.922441+0000","last_fullsized":"2024-09-21T01:50:23.922441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:34.226552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.940062+0000","last_change":"2024-09-21T01:50:22.932093+0000","last_active":"2024-09-21T01:50:22.940062+0000","last_peered":"2024-09-21T01:50:22.940062+0000","last_clean":"2024-09-21T01:50:22.940062+0000","last_became_active":"2024-09-21T01:50:22.931766+0000","last_became_peered":"2024-09-21T01:50:22.931766+0000","last_unstale":"2024-09-21T01:50:22.940062+0000","last_undegraded":"2024-09-21T01:50:22.940062+0000","last_fullsized":"2024-09-21T01:50:22.940062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:26.881009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922183+0000","last_change":"2024-09-21T01:50:21.929799+0000","last_active":"2024-09-21T01:50:23.922183+0000","last_peered":"2024-09-21T01:50:23.922183+0000","last_clean":"2024-09-21T01:50:23.922183+0000","last_became_active":"2024-09-21T01:50:21.929028+0000","last_became_peered":"2024-09-21T01:50:21.929028+0000","last_unstale":"2024-09-21T01:50:23.922183+0000","last_undegraded":"2024-09-21T01:50:23.922183+0000","last_fullsized":"2024-09-21T01:50:23.922183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:26.581913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945506+0000","last_change":"2024-09-21T01:50:22.933849+0000","last_active":"2024-09-21T01:50:23.945506+0000","last_peered":"2024-09-21T01:50:23.945506+0000","last_clean":"2024-09-21T01:50:23.945506+0000","last_became_active":"2024-09-21T01:50:22.933322+0000","last_became_peered":"2024-09-21T01:50:22.933322+0000","last_unstale":"2024-09-21T01:50:23.945506+0000","last_undegraded":"2024-09-21T01:50:23.945506+0000","last_fullsized":"2024-09-21T01:50:23.945506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:01.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922712+0000","last_change":"2024-09-21T01:50:21.940971+0000","last_active":"2024-09-21T01:50:23.922712+0000","last_peered":"2024-09-21T01:50:23.922712+0000","last_clean":"2024-09-21T01:50:23.922712+0000","last_became_active":"2024-09-21T01:50:21.940271+0000","last_became_peered":"2024-09-21T01:50:21.940271+0000","last_unstale":"2024-09-21T01:50:23.922712+0000","last_undegraded":"2024-09-21T01:50:23.922712+0000","last_fullsized":"2024-09-21T01:50:23.922712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:28.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922589+0000","last_change":"2024-09-21T01:50:22.937231+0000","last_active":"2024-09-21T01:50:23.922589+0000","last_peered":"2024-09-21T01:50:23.922589+0000","last_clean":"2024-09-21T01:50:23.922589+0000","last_became_active":"2024-09-21T01:50:22.936946+0000","last_became_peered":"2024-09-21T01:50:22.936946+0000","last_unstale":"2024-09-21T01:50:23.922589+0000","last_undegraded":"2024-09-21T01:50:23.922589+0000","last_fullsized":"2024-09-21T01:50:23.922589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:18.494639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943155+0000","last_change":"2024-09-21T01:50:21.933290+0000","last_active":"2024-09-21T01:50:23.943155+0000","last_peered":"2024-09-21T01:50:23.943155+0000","last_clean":"2024-09-21T01:50:23.943155+0000","last_became_active":"2024-09-21T01:50:21.932938+0000","last_became_peered":"2024-09-21T01:50:21.932938+0000","last_unstale":"2024-09-21T01:50:23.943155+0000","last_undegraded":"2024-09-21T01:50:23.943155+0000","last_fullsized":"2024-09-21T01:50:23.943155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:06.453555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922944+0000","last_change":"2024-09-21T01:50:22.934107+0000","last_active":"2024-09-21T01:50:23.922944+0000","last_peered":"2024-09-21T01:50:23.922944+0000","last_clean":"2024-09-21T01:50:23.922944+0000","last_became_active":"2024-09-21T01:50:22.933797+0000","last_became_peered":"2024-09-21T01:50:22.933797+0000","last_unstale":"2024-09-21T01:50:23.922944+0000","last_undegraded":"2024-09-21T01:50:23.922944+0000","last_fullsized":"2024-09-21T01:50:23.922944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:06.029662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945181+0000","last_change":"2024-09-21T01:50:21.938559+0000","last_active":"2024-09-21T01:50:23.945181+0000","last_peered":"2024-09-21T01:50:23.945181+0000","last_clean":"2024-09-21T01:50:23.945181+0000","last_became_active":"2024-09-21T01:50:21.938220+0000","last_became_peered":"2024-09-21T01:50:21.938220+0000","last_unstale":"2024-09-21T01:50:23.945181+0000","last_undegraded":"2024-09-21T01:50:23.945181+0000","last_fullsized":"2024-09-21T01:50:23.945181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:06.862534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945033+0000","last_change":"2024-09-21T01:50:22.950204+0000","last_active":"2024-09-21T01:50:23.945033+0000","last_peered":"2024-09-21T01:50:23.945033+0000","last_clean":"2024-09-21T01:50:23.945033+0000","last_became_active":"2024-09-21T01:50:22.949690+0000","last_became_peered":"2024-09-21T01:50:22.949690+0000","last_unstale":"2024-09-21T01:50:23.945033+0000","last_undegraded":"2024-09-21T01:50:23.945033+0000","last_fullsized":"2024-09-21T01:50:23.945033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:54.035962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922921+0000","last_change":"2024-09-21T01:50:21.940248+0000","last_active":"2024-09-21T01:50:23.922921+0000","last_peered":"2024-09-21T01:50:23.922921+0000","last_clean":"2024-09-21T01:50:23.922921+0000","last_became_active":"2024-09-21T01:50:21.939907+0000","last_became_peered":"2024-09-21T01:50:21.939907+0000","last_unstale":"2024-09-21T01:50:23.922921+0000","last_undegraded":"2024-09-21T01:50:23.922921+0000","last_fullsized":"2024-09-21T01:50:23.922921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:09.395017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.941936+0000","last_change":"2024-09-21T01:50:22.934816+0000","last_active":"2024-09-21T01:50:22.941936+0000","last_peered":"2024-09-21T01:50:22.941936+0000","last_clean":"2024-09-21T01:50:22.941936+0000","last_became_active":"2024-09-21T01:50:22.934507+0000","last_became_peered":"2024-09-21T01:50:22.934507+0000","last_unstale":"2024-09-21T01:50:22.941936+0000","last_undegraded":"2024-09-21T01:50:22.941936+0000","last_fullsized":"2024-09-21T01:50:22.941936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:37.025441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923108+0000","last_change":"2024-09-21T01:50:21.927104+0000","last_active":"2024-09-21T01:50:23.923108+0000","last_peered":"2024-09-21T01:50:23.923108+0000","last_clean":"2024-09-21T01:50:23.923108+0000","last_became_active":"2024-09-21T01:50:21.926790+0000","last_became_peered":"2024-09-21T01:50:21.926790+0000","last_unstale":"2024-09-21T01:50:23.923108+0000","last_undegraded":"2024-09-21T01:50:23.923108+0000","last_fullsized":"2024-09-21T01:50:23.923108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:45.025442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923056+0000","last_change":"2024-09-21T01:50:22.943334+0000","last_active":"2024-09-21T01:50:23.923056+0000","last_peered":"2024-09-21T01:50:23.923056+0000","last_clean":"2024-09-21T01:50:23.923056+0000","last_became_active":"2024-09-21T01:50:22.942018+0000","last_became_peered":"2024-09-21T01:50:22.942018+0000","last_unstale":"2024-09-21T01:50:23.923056+0000","last_undegraded":"2024-09-21T01:50:23.923056+0000","last_fullsized":"2024-09-21T01:50:23.923056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:01.961942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.922215+0000","last_change":"2024-09-21T01:50:21.938167+0000","last_active":"2024-09-21T01:50:22.922215+0000","last_peered":"2024-09-21T01:50:22.922215+0000","last_clean":"2024-09-21T01:50:22.922215+0000","last_became_active":"2024-09-21T01:50:21.937222+0000","last_became_peered":"2024-09-21T01:50:21.937222+0000","last_unstale":"2024-09-21T01:50:22.922215+0000","last_undegraded":"2024-09-21T01:50:22.922215+0000","last_fullsized":"2024-09-21T01:50:22.922215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:00.285530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943781+0000","last_change":"2024-09-21T01:50:22.944481+0000","last_active":"2024-09-21T01:50:23.943781+0000","last_peered":"2024-09-21T01:50:23.943781+0000","last_clean":"2024-09-21T01:50:23.943781+0000","last_became_active":"2024-09-21T01:50:22.943841+0000","last_became_peered":"2024-09-21T01:50:22.943841+0000","last_unstale":"2024-09-21T01:50:23.943781+0000","last_undegraded":"2024-09-21T01:50:23.943781+0000","last_fullsized":"2024-09-21T01:50:23.943781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:00.475932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922259+0000","last_change":"2024-09-21T01:50:21.941591+0000","last_active":"2024-09-21T01:50:23.922259+0000","last_peered":"2024-09-21T01:50:23.922259+0000","last_clean":"2024-09-21T01:50:23.922259+0000","last_became_active":"2024-09-21T01:50:21.939995+0000","last_became_peered":"2024-09-21T01:50:21.939995+0000","last_unstale":"2024-09-21T01:50:23.922259+0000","last_undegraded":"2024-09-21T01:50:23.922259+0000","last_fullsized":"2024-09-21T01:50:23.922259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:44.472563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944690+0000","last_change":"2024-09-21T01:50:22.938910+0000","last_active":"2024-09-21T01:50:23.944690+0000","last_peered":"2024-09-21T01:50:23.944690+0000","last_clean":"2024-09-21T01:50:23.944690+0000","last_became_active":"2024-09-21T01:50:22.938604+0000","last_became_peered":"2024-09-21T01:50:22.938604+0000","last_unstale":"2024-09-21T01:50:23.944690+0000","last_undegraded":"2024-09-21T01:50:23.944690+0000","last_fullsized":"2024-09-21T01:50:23.944690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:35.625465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922340+0000","last_change":"2024-09-21T01:50:21.937440+0000","last_active":"2024-09-21T01:50:23.922340+0000","last_peered":"2024-09-21T01:50:23.922340+0000","last_clean":"2024-09-21T01:50:23.922340+0000","last_became_active":"2024-09-21T01:50:21.936391+0000","last_became_peered":"2024-09-21T01:50:21.936391+0000","last_unstale":"2024-09-21T01:50:23.922340+0000","last_undegraded":"2024-09-21T01:50:23.922340+0000","last_fullsized":"2024-09-21T01:50:23.922340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:40.296960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922607+0000","last_change":"2024-09-21T01:50:22.933292+0000","last_active":"2024-09-21T01:50:23.922607+0000","last_peered":"2024-09-21T01:50:23.922607+0000","last_clean":"2024-09-21T01:50:23.922607+0000","last_became_active":"2024-09-21T01:50:22.932678+0000","last_became_peered":"2024-09-21T01:50:22.932678+0000","last_unstale":"2024-09-21T01:50:23.922607+0000","last_undegraded":"2024-09-21T01:50:23.922607+0000","last_fullsized":"2024-09-21T01:50:23.922607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:15.679550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.924200+0000","last_change":"2024-09-21T01:50:21.940550+0000","last_active":"2024-09-21T01:50:22.924200+0000","last_peered":"2024-09-21T01:50:22.924200+0000","last_clean":"2024-09-21T01:50:22.924200+0000","last_became_active":"2024-09-21T01:50:21.939857+0000","last_became_peered":"2024-09-21T01:50:21.939857+0000","last_unstale":"2024-09-21T01:50:22.924200+0000","last_undegraded":"2024-09-21T01:50:22.924200+0000","last_fullsized":"2024-09-21T01:50:22.924200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:32.943352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.946678+0000","last_change":"2024-09-21T01:50:22.934235+0000","last_active":"2024-09-21T01:50:23.946678+0000","last_peered":"2024-09-21T01:50:23.946678+0000","last_clean":"2024-09-21T01:50:23.946678+0000","last_became_active":"2024-09-21T01:50:22.933899+0000","last_became_peered":"2024-09-21T01:50:22.933899+0000","last_unstale":"2024-09-21T01:50:23.946678+0000","last_undegraded":"2024-09-21T01:50:23.946678+0000","last_fullsized":"2024-09-21T01:50:23.946678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:22.861515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922747+0000","last_change":"2024-09-21T01:50:21.929417+0000","last_active":"2024-09-21T01:50:23.922747+0000","last_peered":"2024-09-21T01:50:23.922747+0000","last_clean":"2024-09-21T01:50:23.922747+0000","last_became_active":"2024-09-21T01:50:21.929074+0000","last_became_peered":"2024-09-21T01:50:21.929074+0000","last_unstale":"2024-09-21T01:50:23.922747+0000","last_undegraded":"2024-09-21T01:50:23.922747+0000","last_fullsized":"2024-09-21T01:50:23.922747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:38.921120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.943546+0000","last_change":"2024-09-21T01:50:22.940192+0000","last_active":"2024-09-21T01:50:22.943546+0000","last_peered":"2024-09-21T01:50:22.943546+0000","last_clean":"2024-09-21T01:50:22.943546+0000","last_became_active":"2024-09-21T01:50:22.939898+0000","last_became_peered":"2024-09-21T01:50:22.939898+0000","last_unstale":"2024-09-21T01:50:22.943546+0000","last_undegraded":"2024-09-21T01:50:22.943546+0000","last_fullsized":"2024-09-21T01:50:22.943546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:10:12.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922732+0000","last_change":"2024-09-21T01:50:21.933538+0000","last_active":"2024-09-21T01:50:23.922732+0000","last_peered":"2024-09-21T01:50:23.922732+0000","last_clean":"2024-09-21T01:50:23.922732+0000","last_became_active":"2024-09-21T01:50:21.933171+0000","last_became_peered":"2024-09-21T01:50:21.933171+0000","last_unstale":"2024-09-21T01:50:23.922732+0000","last_undegraded":"2024-09-21T01:50:23.922732+0000","last_fullsized":"2024-09-21T01:50:23.922732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:33.837036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938201+0000","last_change":"2024-09-21T01:50:22.934823+0000","last_active":"2024-09-21T01:50:22.938201+0000","last_peered":"2024-09-21T01:50:22.938201+0000","last_clean":"2024-09-21T01:50:22.938201+0000","last_became_active":"2024-09-21T01:50:22.934503+0000","last_became_peered":"2024-09-21T01:50:22.934503+0000","last_unstale":"2024-09-21T01:50:22.938201+0000","last_undegraded":"2024-09-21T01:50:22.938201+0000","last_fullsized":"2024-09-21T01:50:22.938201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:35.726572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922817+0000","last_change":"2024-09-21T01:50:21.933013+0000","last_active":"2024-09-21T01:50:23.922817+0000","last_peered":"2024-09-21T01:50:23.922817+0000","last_clean":"2024-09-21T01:50:23.922817+0000","last_became_active":"2024-09-21T01:50:21.932474+0000","last_became_peered":"2024-09-21T01:50:21.932474+0000","last_unstale":"2024-09-21T01:50:23.922817+0000","last_undegraded":"2024-09-21T01:50:23.922817+0000","last_fullsized":"2024-09-21T01:50:23.922817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:15.625865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938302+0000","last_change":"2024-09-21T01:50:22.936551+0000","last_active":"2024-09-21T01:50:22.938302+0000","last_peered":"2024-09-21T01:50:22.938302+0000","last_clean":"2024-09-21T01:50:22.938302+0000","last_became_active":"2024-09-21T01:50:22.935715+0000","last_became_peered":"2024-09-21T01:50:22.935715+0000","last_unstale":"2024-09-21T01:50:22.938302+0000","last_undegraded":"2024-09-21T01:50:22.938302+0000","last_fullsized":"2024-09-21T01:50:22.938302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:33.041297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943655+0000","last_change":"2024-09-21T01:50:21.927714+0000","last_active":"2024-09-21T01:50:23.943655+0000","last_peered":"2024-09-21T01:50:23.943655+0000","last_clean":"2024-09-21T01:50:23.943655+0000","last_became_active":"2024-09-21T01:50:21.927328+0000","last_became_peered":"2024-09-21T01:50:21.927328+0000","last_unstale":"2024-09-21T01:50:23.943655+0000","last_undegraded":"2024-09-21T01:50:23.943655+0000","last_fullsized":"2024-09-21T01:50:23.943655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:28.643414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.942852+0000","last_change":"2024-09-21T01:50:22.941314+0000","last_active":"2024-09-21T01:50:22.942852+0000","last_peered":"2024-09-21T01:50:22.942852+0000","last_clean":"2024-09-21T01:50:22.942852+0000","last_became_active":"2024-09-21T01:50:22.941006+0000","last_became_peered":"2024-09-21T01:50:22.941006+0000","last_unstale":"2024-09-21T01:50:22.942852+0000","last_undegraded":"2024-09-21T01:50:22.942852+0000","last_fullsized":"2024-09-21T01:50:22.942852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:23.960853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944838+0000","last_change":"2024-09-21T01:50:21.937398+0000","last_active":"2024-09-21T01:50:23.944838+0000","last_peered":"2024-09-21T01:50:23.944838+0000","last_clean":"2024-09-21T01:50:23.944838+0000","last_became_active":"2024-09-21T01:50:21.937000+0000","last_became_peered":"2024-09-21T01:50:21.937000+0000","last_unstale":"2024-09-21T01:50:23.944838+0000","last_undegraded":"2024-09-21T01:50:23.944838+0000","last_fullsized":"2024-09-21T01:50:23.944838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:24.984117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.941146+0000","last_change":"2024-09-21T01:50:22.939195+0000","last_active":"2024-09-21T01:50:22.941146+0000","last_peered":"2024-09-21T01:50:22.941146+0000","last_clean":"2024-09-21T01:50:22.941146+0000","last_became_active":"2024-09-21T01:50:22.938885+0000","last_became_peered":"2024-09-21T01:50:22.938885+0000","last_unstale":"2024-09-21T01:50:22.941146+0000","last_undegraded":"2024-09-21T01:50:22.941146+0000","last_fullsized":"2024-09-21T01:50:22.941146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:39.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922054+0000","last_change":"2024-09-21T01:50:21.927988+0000","last_active":"2024-09-21T01:50:23.922054+0000","last_peered":"2024-09-21T01:50:23.922054+0000","last_clean":"2024-09-21T01:50:23.922054+0000","last_became_active":"2024-09-21T01:50:21.927672+0000","last_became_peered":"2024-09-21T01:50:21.927672+0000","last_unstale":"2024-09-21T01:50:23.922054+0000","last_undegraded":"2024-09-21T01:50:23.922054+0000","last_fullsized":"2024-09-21T01:50:23.922054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.881867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943764+0000","last_change":"2024-09-21T01:50:22.947890+0000","last_active":"2024-09-21T01:50:23.943764+0000","last_peered":"2024-09-21T01:50:23.943764+0000","last_clean":"2024-09-21T01:50:23.943764+0000","last_became_active":"2024-09-21T01:50:22.946023+0000","last_became_peered":"2024-09-21T01:50:22.946023+0000","last_unstale":"2024-09-21T01:50:23.943764+0000","last_undegraded":"2024-09-21T01:50:23.943764+0000","last_fullsized":"2024-09-21T01:50:23.943764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:31.229365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945443+0000","last_change":"2024-09-21T01:50:21.937955+0000","last_active":"2024-09-21T01:50:23.945443+0000","last_peered":"2024-09-21T01:50:23.945443+0000","last_clean":"2024-09-21T01:50:23.945443+0000","last_became_active":"2024-09-21T01:50:21.937630+0000","last_became_peered":"2024-09-21T01:50:21.937630+0000","last_unstale":"2024-09-21T01:50:23.945443+0000","last_undegraded":"2024-09-21T01:50:23.945443+0000","last_fullsized":"2024-09-21T01:50:23.945443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:28.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.944914+0000","last_change":"2024-09-21T01:50:22.942957+0000","last_active":"2024-09-21T01:50:22.944914+0000","last_peered":"2024-09-21T01:50:22.944914+0000","last_clean":"2024-09-21T01:50:22.944914+0000","last_became_active":"2024-09-21T01:50:22.942635+0000","last_became_peered":"2024-09-21T01:50:22.942635+0000","last_unstale":"2024-09-21T01:50:22.944914+0000","last_undegraded":"2024-09-21T01:50:22.944914+0000","last_fullsized":"2024-09-21T01:50:22.944914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:00.767514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.954302+0000","last_change":"2024-09-21T01:50:21.936422+0000","last_active":"2024-09-21T01:50:22.954302+0000","last_peered":"2024-09-21T01:50:22.954302+0000","last_clean":"2024-09-21T01:50:22.954302+0000","last_became_active":"2024-09-21T01:50:21.936098+0000","last_became_peered":"2024-09-21T01:50:21.936098+0000","last_unstale":"2024-09-21T01:50:22.954302+0000","last_undegraded":"2024-09-21T01:50:22.954302+0000","last_fullsized":"2024-09-21T01:50:22.954302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:08.922903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.946735+0000","last_change":"2024-09-21T01:50:22.953457+0000","last_active":"2024-09-21T01:50:23.946735+0000","last_peered":"2024-09-21T01:50:23.946735+0000","last_clean":"2024-09-21T01:50:23.946735+0000","last_became_active":"2024-09-21T01:50:22.953117+0000","last_became_peered":"2024-09-21T01:50:22.953117+0000","last_unstale":"2024-09-21T01:50:23.946735+0000","last_undegraded":"2024-09-21T01:50:23.946735+0000","last_fullsized":"2024-09-21T01:50:23.946735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:52.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943228+0000","last_change":"2024-09-21T01:50:21.928483+0000","last_active":"2024-09-21T01:50:23.943228+0000","last_peered":"2024-09-21T01:50:23.943228+0000","last_clean":"2024-09-21T01:50:23.943228+0000","last_became_active":"2024-09-21T01:50:21.928151+0000","last_became_peered":"2024-09-21T01:50:21.928151+0000","last_unstale":"2024-09-21T01:50:23.943228+0000","last_undegraded":"2024-09-21T01:50:23.943228+0000","last_fullsized":"2024-09-21T01:50:23.943228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:02.367816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.942900+0000","last_change":"2024-09-21T01:50:22.945039+0000","last_active":"2024-09-21T01:50:23.942900+0000","last_peered":"2024-09-21T01:50:23.942900+0000","last_clean":"2024-09-21T01:50:23.942900+0000","last_became_active":"2024-09-21T01:50:22.944709+0000","last_became_peered":"2024-09-21T01:50:22.944709+0000","last_unstale":"2024-09-21T01:50:23.942900+0000","last_undegraded":"2024-09-21T01:50:23.942900+0000","last_fullsized":"2024-09-21T01:50:23.942900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:10.398030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.923756+0000","last_change":"2024-09-21T01:50:21.937574+0000","last_active":"2024-09-21T01:50:22.923756+0000","last_peered":"2024-09-21T01:50:22.923756+0000","last_clean":"2024-09-21T01:50:22.923756+0000","last_became_active":"2024-09-21T01:50:21.937230+0000","last_became_peered":"2024-09-21T01:50:21.937230+0000","last_unstale":"2024-09-21T01:50:22.923756+0000","last_undegraded":"2024-09-21T01:50:22.923756+0000","last_fullsized":"2024-09-21T01:50:22.923756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:29.822079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944995+0000","last_change":"2024-09-21T01:50:22.941632+0000","last_active":"2024-09-21T01:50:23.944995+0000","last_peered":"2024-09-21T01:50:23.944995+0000","last_clean":"2024-09-21T01:50:23.944995+0000","last_became_active":"2024-09-21T01:50:22.941242+0000","last_became_peered":"2024-09-21T01:50:22.941242+0000","last_unstale":"2024-09-21T01:50:23.944995+0000","last_undegraded":"2024-09-21T01:50:23.944995+0000","last_fullsized":"2024-09-21T01:50:23.944995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:34.041532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943862+0000","last_change":"2024-09-21T01:50:21.936458+0000","last_active":"2024-09-21T01:50:23.943862+0000","last_peered":"2024-09-21T01:50:23.943862+0000","last_clean":"2024-09-21T01:50:23.943862+0000","last_became_active":"2024-09-21T01:50:21.936107+0000","last_became_peered":"2024-09-21T01:50:21.936107+0000","last_unstale":"2024-09-21T01:50:23.943862+0000","last_undegraded":"2024-09-21T01:50:23.943862+0000","last_fullsized":"2024-09-21T01:50:23.943862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:38.255635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943447+0000","last_change":"2024-09-21T01:50:22.949881+0000","last_active":"2024-09-21T01:50:23.943447+0000","last_peered":"2024-09-21T01:50:23.943447+0000","last_clean":"2024-09-21T01:50:23.943447+0000","last_became_active":"2024-09-21T01:50:22.949465+0000","last_became_peered":"2024-09-21T01:50:22.949465+0000","last_unstale":"2024-09-21T01:50:23.943447+0000","last_undegraded":"2024-09-21T01:50:23.943447+0000","last_fullsized":"2024-09-21T01:50:23.943447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:42.587312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.922453+0000","last_change":"2024-09-21T01:50:21.938652+0000","last_active":"2024-09-21T01:50:22.922453+0000","last_peered":"2024-09-21T01:50:22.922453+0000","last_clean":"2024-09-21T01:50:22.922453+0000","last_became_active":"2024-09-21T01:50:21.938240+0000","last_became_peered":"2024-09-21T01:50:21.938240+0000","last_unstale":"2024-09-21T01:50:22.922453+0000","last_undegraded":"2024-09-21T01:50:22.922453+0000","last_fullsized":"2024-09-21T01:50:22.922453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.328120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922259+0000","last_change":"2024-09-21T01:50:22.930528+0000","last_active":"2024-09-21T01:50:23.922259+0000","last_peered":"2024-09-21T01:50:23.922259+0000","last_clean":"2024-09-21T01:50:23.922259+0000","last_became_active":"2024-09-21T01:50:22.930082+0000","last_became_peered":"2024-09-21T01:50:22.930082+0000","last_unstale":"2024-09-21T01:50:23.922259+0000","last_undegraded":"2024-09-21T01:50:23.922259+0000","last_fullsized":"2024-09-21T01:50:23.922259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:29:51.340786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922175+0000","last_change":"2024-09-21T01:50:21.934955+0000","last_active":"2024-09-21T01:50:23.922175+0000","last_peered":"2024-09-21T01:50:23.922175+0000","last_clean":"2024-09-21T01:50:23.922175+0000","last_became_active":"2024-09-21T01:50:21.934527+0000","last_became_peered":"2024-09-21T01:50:21.934527+0000","last_unstale":"2024-09-21T01:50:23.922175+0000","last_undegraded":"2024-09-21T01:50:23.922175+0000","last_fullsized":"2024-09-21T01:50:23.922175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:46.497219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922168+0000","last_change":"2024-09-21T01:50:22.935496+0000","last_active":"2024-09-21T01:50:23.922168+0000","last_peered":"2024-09-21T01:50:23.922168+0000","last_clean":"2024-09-21T01:50:23.922168+0000","last_became_active":"2024-09-21T01:50:22.935097+0000","last_became_peered":"2024-09-21T01:50:22.935097+0000","last_unstale":"2024-09-21T01:50:23.922168+0000","last_undegraded":"2024-09-21T01:50:23.922168+0000","last_fullsized":"2024-09-21T01:50:23.922168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:35.625465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922220+0000","last_change":"2024-09-21T01:50:21.937793+0000","last_active":"2024-09-21T01:50:23.922220+0000","last_peered":"2024-09-21T01:50:23.922220+0000","last_clean":"2024-09-21T01:50:23.922220+0000","last_became_active":"2024-09-21T01:50:21.936875+0000","last_became_peered":"2024-09-21T01:50:21.936875+0000","last_unstale":"2024-09-21T01:50:23.922220+0000","last_undegraded":"2024-09-21T01:50:23.922220+0000","last_fullsized":"2024-09-21T01:50:23.922220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:14.772788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944238+0000","last_change":"2024-09-21T01:50:22.937162+0000","last_active":"2024-09-21T01:50:23.944238+0000","last_peered":"2024-09-21T01:50:23.944238+0000","last_clean":"2024-09-21T01:50:23.944238+0000","last_became_active":"2024-09-21T01:50:22.936460+0000","last_became_peered":"2024-09-21T01:50:22.936460+0000","last_unstale":"2024-09-21T01:50:23.944238+0000","last_undegraded":"2024-09-21T01:50:23.944238+0000","last_fullsized":"2024-09-21T01:50:23.944238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:01.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943785+0000","last_change":"2024-09-21T01:50:21.932714+0000","last_active":"2024-09-21T01:50:23.943785+0000","last_peered":"2024-09-21T01:50:23.943785+0000","last_clean":"2024-09-21T01:50:23.943785+0000","last_became_active":"2024-09-21T01:50:21.932341+0000","last_became_peered":"2024-09-21T01:50:21.932341+0000","last_unstale":"2024-09-21T01:50:23.943785+0000","last_undegraded":"2024-09-21T01:50:23.943785+0000","last_fullsized":"2024-09-21T01:50:23.943785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:33.747031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944559+0000","last_change":"2024-09-21T01:49:29.995848+0000","last_active":"2024-09-21T01:50:23.944559+0000","last_peered":"2024-09-21T01:50:23.944559+0000","last_clean":"2024-09-21T01:50:23.944559+0000","last_became_active":"2024-09-21T01:49:29.994790+0000","last_became_peered":"2024-09-21T01:49:29.994790+0000","last_unstale":"2024-09-21T01:50:23.944559+0000","last_undegraded":"2024-09-21T01:50:23.944559+0000","last_fullsized":"2024-09-21T01:50:23.944559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_clean_scrub_stamp":"2024-09-21T01:49:28.252238+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:30.318506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":937984,"data_stored":719317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":129475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":129531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":348160,"data_stored":128963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":356352,"data_stored":130493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":719227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:50:27.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T01:50:27.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.169+0000 7f66b9190640 1 -- 172.21.15.40:0/3356702284 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66b40cf540 msgr2=0x7f66b40b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.169+0000 7f66b9190640 1 --2- 172.21.15.40:0/3356702284 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66b40cf540 0x7f66b40b5fa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f669c009830 tx=0x7f669c02a3f0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.169+0000 7f66b9190640 1 -- 172.21.15.40:0/3356702284 shutdown_connections 2024-09-21T01:50:27.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.169+0000 7f66b9190640 1 --2- 172.21.15.40:0/3356702284 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66b40cf540 0x7f66b40b5fa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.169+0000 7f66b9190640 1 --2- 172.21.15.40:0/3356702284 >> v2:172.21.15.139:3300/0 conn(0x7f66b40b9b60 0x7f66b40d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.169+0000 7f66b9190640 1 -- 172.21.15.40:0/3356702284 >> 172.21.15.40:0/3356702284 conn(0x7f66b409d7f0 msgr2=0x7f66b40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:27.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.169+0000 7f66b9190640 1 -- 172.21.15.40:0/3356702284 shutdown_connections 2024-09-21T01:50:27.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.169+0000 7f66b9190640 1 -- 172.21.15.40:0/3356702284 wait complete. 2024-09-21T01:50:27.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.171+0000 7f66b9190640 1 Processor -- start 2024-09-21T01:50:27.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.171+0000 7f66b9190640 1 -- start start 2024-09-21T01:50:27.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.172+0000 7f66b9190640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40b64e0 0x7f66b414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:27.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.172+0000 7f66b9190640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66b40b9b60 0x7f66b414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:27.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.172+0000 7f66b9190640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66b40cf540 0x7f66b414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:27.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.172+0000 7f66b9190640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f66b40d2e40 con 0x7f66b40b64e0 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b9190640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f66b40d2cc0 con 0x7f66b40b9b60 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b9190640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f66b40d2fc0 con 0x7f66b40cf540 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40b64e0 0x7f66b414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40b64e0 0x7f66b414d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47606/0 (socket says 172.21.15.40:47606) 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b2d9d640 1 -- 172.21.15.40:0/2654610672 learned_addr learned my addr 172.21.15.40:0/2654610672 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66abfff640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66b40b9b60 0x7f66b414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b359e640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66b40cf540 0x7f66b414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b2d9d640 1 -- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66b40cf540 msgr2=0x7f66b414dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b2d9d640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66b40cf540 0x7f66b414dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b2d9d640 1 -- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66b40b9b60 msgr2=0x7f66b414d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b2d9d640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66b40b9b60 0x7f66b414d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b2d9d640 1 -- 172.21.15.40:0/2654610672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b40c9ab0 con 0x7f66b40b64e0 2024-09-21T01:50:27.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b2d9d640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40b64e0 0x7f66b414d060 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f66a400e9f0 tx=0x7f66a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:27.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66ab7fe640 1 -- 172.21.15.40:0/2654610672 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a400cd80 con 0x7f66b40b64e0 2024-09-21T01:50:27.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66ab7fe640 1 -- 172.21.15.40:0/2654610672 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66a4004020 con 0x7f66b40b64e0 2024-09-21T01:50:27.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66b40c9d70 con 0x7f66b40b64e0 2024-09-21T01:50:27.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.173+0000 7f66ab7fe640 1 -- 172.21.15.40:0/2654610672 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4004470 con 0x7f66b40b64e0 2024-09-21T01:50:27.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.174+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66b40ca330 con 0x7f66b40b64e0 2024-09-21T01:50:27.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.174+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66b40d3470 con 0x7f66b40b64e0 2024-09-21T01:50:27.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.175+0000 7f66ab7fe640 1 -- 172.21.15.40:0/2654610672 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66a4005030 con 0x7f66b40b64e0 2024-09-21T01:50:27.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.176+0000 7f66ab7fe640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6694078bc0 0x7f669407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:27.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.176+0000 7f66ab7fe640 1 -- 172.21.15.40:0/2654610672 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f66a409b5a0 con 0x7f66b40b64e0 2024-09-21T01:50:27.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.176+0000 7f66abfff640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6694078bc0 0x7f669407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:27.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.177+0000 7f66abfff640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6694078bc0 0x7f669407b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f669c034000 tx=0x7f669c004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:27.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.181+0000 7f66ab7fe640 1 -- 172.21.15.40:0/2654610672 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f66a40632f0 con 0x7f66b40b64e0 2024-09-21T01:50:27.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.366+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 --> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66b40d3fb0 con 0x7f6694078bc0 2024-09-21T01:50:27.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.371+0000 7f66ab7fe640 1 -- 172.21.15.40:0/2654610672 <== mgr.4100 v2:172.21.15.139:6800/852736644 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251933 (secure 0 0 0) 0x7f66b40d3fb0 con 0x7f6694078bc0 2024-09-21T01:50:27.374 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:27.375 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-21T01:50:27.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6694078bc0 msgr2=0x7f669407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6694078bc0 0x7f669407b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f669c034000 tx=0x7f669c004730 comp rx=0 tx=0).stop 2024-09-21T01:50:27.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40b64e0 msgr2=0x7f66b414d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40b64e0 0x7f66b414d060 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f66a400e9f0 tx=0x7f66a400eeb0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 shutdown_connections 2024-09-21T01:50:27.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6694078bc0 0x7f669407b0d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f66b40cf540 0x7f66b414dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f66b40b9b60 0x7f66b414d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 --2- 172.21.15.40:0/2654610672 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66b40b64e0 0x7f66b414d060 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 >> 172.21.15.40:0/2654610672 conn(0x7f66b409d7f0 msgr2=0x7f66b40d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:27.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 shutdown_connections 2024-09-21T01:50:27.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.374+0000 7f66b9190640 1 -- 172.21.15.40:0/2654610672 wait complete. 2024-09-21T01:50:27.386 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-21T01:50:27.321488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220092,"kb_used_data":3836,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754628,"statfs":{"total":773094113280,"available":772868739072,"internally_reserved":0,"allocated":3928064,"data_stored":2201174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001738"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944969+0000","last_change":"2024-09-21T01:50:22.938230+0000","last_active":"2024-09-21T01:50:23.944969+0000","last_peered":"2024-09-21T01:50:23.944969+0000","last_clean":"2024-09-21T01:50:23.944969+0000","last_became_active":"2024-09-21T01:50:22.937879+0000","last_became_peered":"2024-09-21T01:50:22.937879+0000","last_unstale":"2024-09-21T01:50:23.944969+0000","last_undegraded":"2024-09-21T01:50:23.944969+0000","last_fullsized":"2024-09-21T01:50:23.944969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:15.679550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922905+0000","last_change":"2024-09-21T01:50:22.938036+0000","last_active":"2024-09-21T01:50:23.922905+0000","last_peered":"2024-09-21T01:50:23.922905+0000","last_clean":"2024-09-21T01:50:23.922905+0000","last_became_active":"2024-09-21T01:50:22.937728+0000","last_became_peered":"2024-09-21T01:50:22.937728+0000","last_unstale":"2024-09-21T01:50:23.922905+0000","last_undegraded":"2024-09-21T01:50:23.922905+0000","last_fullsized":"2024-09-21T01:50:23.922905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:19.587920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945285+0000","last_change":"2024-09-21T01:50:22.949179+0000","last_active":"2024-09-21T01:50:23.945285+0000","last_peered":"2024-09-21T01:50:23.945285+0000","last_clean":"2024-09-21T01:50:23.945285+0000","last_became_active":"2024-09-21T01:50:22.948846+0000","last_became_peered":"2024-09-21T01:50:22.948846+0000","last_unstale":"2024-09-21T01:50:23.945285+0000","last_undegraded":"2024-09-21T01:50:23.945285+0000","last_fullsized":"2024-09-21T01:50:23.945285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:30.303028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.941895+0000","last_change":"2024-09-21T01:50:22.935589+0000","last_active":"2024-09-21T01:50:22.941895+0000","last_peered":"2024-09-21T01:50:22.941895+0000","last_clean":"2024-09-21T01:50:22.941895+0000","last_became_active":"2024-09-21T01:50:22.934379+0000","last_became_peered":"2024-09-21T01:50:22.934379+0000","last_unstale":"2024-09-21T01:50:22.941895+0000","last_undegraded":"2024-09-21T01:50:22.941895+0000","last_fullsized":"2024-09-21T01:50:22.941895+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:45.807548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938245+0000","last_change":"2024-09-21T01:50:22.934017+0000","last_active":"2024-09-21T01:50:22.938245+0000","last_peered":"2024-09-21T01:50:22.938245+0000","last_clean":"2024-09-21T01:50:22.938245+0000","last_became_active":"2024-09-21T01:50:22.933647+0000","last_became_peered":"2024-09-21T01:50:22.933647+0000","last_unstale":"2024-09-21T01:50:22.938245+0000","last_undegraded":"2024-09-21T01:50:22.938245+0000","last_fullsized":"2024-09-21T01:50:22.938245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:37:28.024099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922614+0000","last_change":"2024-09-21T01:50:22.930225+0000","last_active":"2024-09-21T01:50:23.922614+0000","last_peered":"2024-09-21T01:50:23.922614+0000","last_clean":"2024-09-21T01:50:23.922614+0000","last_became_active":"2024-09-21T01:50:22.929889+0000","last_became_peered":"2024-09-21T01:50:22.929889+0000","last_unstale":"2024-09-21T01:50:23.922614+0000","last_undegraded":"2024-09-21T01:50:23.922614+0000","last_fullsized":"2024-09-21T01:50:23.922614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:22.861515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944242+0000","last_change":"2024-09-21T01:50:22.945792+0000","last_active":"2024-09-21T01:50:23.944242+0000","last_peered":"2024-09-21T01:50:23.944242+0000","last_clean":"2024-09-21T01:50:23.944242+0000","last_became_active":"2024-09-21T01:50:22.945488+0000","last_became_peered":"2024-09-21T01:50:22.945488+0000","last_unstale":"2024-09-21T01:50:23.944242+0000","last_undegraded":"2024-09-21T01:50:23.944242+0000","last_fullsized":"2024-09-21T01:50:23.944242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:29:51.340786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943528+0000","last_change":"2024-09-21T01:50:22.938825+0000","last_active":"2024-09-21T01:50:23.943528+0000","last_peered":"2024-09-21T01:50:23.943528+0000","last_clean":"2024-09-21T01:50:23.943528+0000","last_became_active":"2024-09-21T01:50:22.938530+0000","last_became_peered":"2024-09-21T01:50:22.938530+0000","last_unstale":"2024-09-21T01:50:23.943528+0000","last_undegraded":"2024-09-21T01:50:23.943528+0000","last_fullsized":"2024-09-21T01:50:23.943528+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:27.851164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922734+0000","last_change":"2024-09-21T01:50:22.932459+0000","last_active":"2024-09-21T01:50:23.922734+0000","last_peered":"2024-09-21T01:50:23.922734+0000","last_clean":"2024-09-21T01:50:23.922734+0000","last_became_active":"2024-09-21T01:50:22.932098+0000","last_became_peered":"2024-09-21T01:50:22.932098+0000","last_unstale":"2024-09-21T01:50:23.922734+0000","last_undegraded":"2024-09-21T01:50:23.922734+0000","last_fullsized":"2024-09-21T01:50:23.922734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:12.461898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.941773+0000","last_change":"2024-09-21T01:50:22.934659+0000","last_active":"2024-09-21T01:50:22.941773+0000","last_peered":"2024-09-21T01:50:22.941773+0000","last_clean":"2024-09-21T01:50:22.941773+0000","last_became_active":"2024-09-21T01:50:22.934310+0000","last_became_peered":"2024-09-21T01:50:22.934310+0000","last_unstale":"2024-09-21T01:50:22.941773+0000","last_undegraded":"2024-09-21T01:50:22.941773+0000","last_fullsized":"2024-09-21T01:50:22.941773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:52.913208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943883+0000","last_change":"2024-09-21T01:50:22.948538+0000","last_active":"2024-09-21T01:50:23.943883+0000","last_peered":"2024-09-21T01:50:23.943883+0000","last_clean":"2024-09-21T01:50:23.943883+0000","last_became_active":"2024-09-21T01:50:22.948219+0000","last_became_peered":"2024-09-21T01:50:22.948219+0000","last_unstale":"2024-09-21T01:50:23.943883+0000","last_undegraded":"2024-09-21T01:50:23.943883+0000","last_fullsized":"2024-09-21T01:50:23.943883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:03.184965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945915+0000","last_change":"2024-09-21T01:50:22.933672+0000","last_active":"2024-09-21T01:50:23.945915+0000","last_peered":"2024-09-21T01:50:23.945915+0000","last_clean":"2024-09-21T01:50:23.945915+0000","last_became_active":"2024-09-21T01:50:22.933307+0000","last_became_peered":"2024-09-21T01:50:22.933307+0000","last_unstale":"2024-09-21T01:50:23.945915+0000","last_undegraded":"2024-09-21T01:50:23.945915+0000","last_fullsized":"2024-09-21T01:50:23.945915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:08.575412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.946779+0000","last_change":"2024-09-21T01:50:22.945718+0000","last_active":"2024-09-21T01:50:22.946779+0000","last_peered":"2024-09-21T01:50:22.946779+0000","last_clean":"2024-09-21T01:50:22.946779+0000","last_became_active":"2024-09-21T01:50:22.945375+0000","last_became_peered":"2024-09-21T01:50:22.945375+0000","last_unstale":"2024-09-21T01:50:22.946779+0000","last_undegraded":"2024-09-21T01:50:22.946779+0000","last_fullsized":"2024-09-21T01:50:22.946779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:01.180944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922843+0000","last_change":"2024-09-21T01:50:22.939076+0000","last_active":"2024-09-21T01:50:23.922843+0000","last_peered":"2024-09-21T01:50:23.922843+0000","last_clean":"2024-09-21T01:50:23.922843+0000","last_became_active":"2024-09-21T01:50:22.938203+0000","last_became_peered":"2024-09-21T01:50:22.938203+0000","last_unstale":"2024-09-21T01:50:23.922843+0000","last_undegraded":"2024-09-21T01:50:23.922843+0000","last_fullsized":"2024-09-21T01:50:23.922843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:52.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945501+0000","last_change":"2024-09-21T01:50:22.940169+0000","last_active":"2024-09-21T01:50:23.945501+0000","last_peered":"2024-09-21T01:50:23.945501+0000","last_clean":"2024-09-21T01:50:23.945501+0000","last_became_active":"2024-09-21T01:50:22.939821+0000","last_became_peered":"2024-09-21T01:50:22.939821+0000","last_unstale":"2024-09-21T01:50:23.945501+0000","last_undegraded":"2024-09-21T01:50:23.945501+0000","last_fullsized":"2024-09-21T01:50:23.945501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:46.768635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944492+0000","last_change":"2024-09-21T01:50:22.949851+0000","last_active":"2024-09-21T01:50:23.944492+0000","last_peered":"2024-09-21T01:50:23.944492+0000","last_clean":"2024-09-21T01:50:23.944492+0000","last_became_active":"2024-09-21T01:50:22.949535+0000","last_became_peered":"2024-09-21T01:50:22.949535+0000","last_unstale":"2024-09-21T01:50:23.944492+0000","last_undegraded":"2024-09-21T01:50:23.944492+0000","last_fullsized":"2024-09-21T01:50:23.944492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:18.494639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944394+0000","last_change":"2024-09-21T01:50:22.951560+0000","last_active":"2024-09-21T01:50:23.944394+0000","last_peered":"2024-09-21T01:50:23.944394+0000","last_clean":"2024-09-21T01:50:23.944394+0000","last_became_active":"2024-09-21T01:50:22.951172+0000","last_became_peered":"2024-09-21T01:50:22.951172+0000","last_unstale":"2024-09-21T01:50:23.944394+0000","last_undegraded":"2024-09-21T01:50:23.944394+0000","last_fullsized":"2024-09-21T01:50:23.944394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:08.575412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923132+0000","last_change":"2024-09-21T01:50:22.937120+0000","last_active":"2024-09-21T01:50:23.923132+0000","last_peered":"2024-09-21T01:50:23.923132+0000","last_clean":"2024-09-21T01:50:23.923132+0000","last_became_active":"2024-09-21T01:50:22.936701+0000","last_became_peered":"2024-09-21T01:50:22.936701+0000","last_unstale":"2024-09-21T01:50:23.923132+0000","last_undegraded":"2024-09-21T01:50:23.923132+0000","last_fullsized":"2024-09-21T01:50:23.923132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:40:08.806012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922424+0000","last_change":"2024-09-21T01:50:22.938015+0000","last_active":"2024-09-21T01:50:23.922424+0000","last_peered":"2024-09-21T01:50:23.922424+0000","last_clean":"2024-09-21T01:50:23.922424+0000","last_became_active":"2024-09-21T01:50:22.937610+0000","last_became_peered":"2024-09-21T01:50:22.937610+0000","last_unstale":"2024-09-21T01:50:23.922424+0000","last_undegraded":"2024-09-21T01:50:23.922424+0000","last_fullsized":"2024-09-21T01:50:23.922424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:08.575412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938579+0000","last_change":"2024-09-21T01:50:22.934043+0000","last_active":"2024-09-21T01:50:22.938579+0000","last_peered":"2024-09-21T01:50:22.938579+0000","last_clean":"2024-09-21T01:50:22.938579+0000","last_became_active":"2024-09-21T01:50:22.933593+0000","last_became_peered":"2024-09-21T01:50:22.933593+0000","last_unstale":"2024-09-21T01:50:22.938579+0000","last_undegraded":"2024-09-21T01:50:22.938579+0000","last_fullsized":"2024-09-21T01:50:22.938579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:15.390413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922928+0000","last_change":"2024-09-21T01:50:22.942951+0000","last_active":"2024-09-21T01:50:23.922928+0000","last_peered":"2024-09-21T01:50:23.922928+0000","last_clean":"2024-09-21T01:50:23.922928+0000","last_became_active":"2024-09-21T01:50:22.942650+0000","last_became_peered":"2024-09-21T01:50:22.942650+0000","last_unstale":"2024-09-21T01:50:23.922928+0000","last_undegraded":"2024-09-21T01:50:23.922928+0000","last_fullsized":"2024-09-21T01:50:23.922928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:51.759417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922749+0000","last_change":"2024-09-21T01:50:22.934555+0000","last_active":"2024-09-21T01:50:23.922749+0000","last_peered":"2024-09-21T01:50:23.922749+0000","last_clean":"2024-09-21T01:50:23.922749+0000","last_became_active":"2024-09-21T01:50:22.934206+0000","last_became_peered":"2024-09-21T01:50:22.934206+0000","last_unstale":"2024-09-21T01:50:23.922749+0000","last_undegraded":"2024-09-21T01:50:23.922749+0000","last_fullsized":"2024-09-21T01:50:23.922749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:35.229566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943023+0000","last_change":"2024-09-21T01:50:22.947386+0000","last_active":"2024-09-21T01:50:23.943023+0000","last_peered":"2024-09-21T01:50:23.943023+0000","last_clean":"2024-09-21T01:50:23.943023+0000","last_became_active":"2024-09-21T01:50:22.947038+0000","last_became_peered":"2024-09-21T01:50:22.947038+0000","last_unstale":"2024-09-21T01:50:23.943023+0000","last_undegraded":"2024-09-21T01:50:23.943023+0000","last_fullsized":"2024-09-21T01:50:23.943023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:35.229566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945600+0000","last_change":"2024-09-21T01:50:22.936259+0000","last_active":"2024-09-21T01:50:23.945600+0000","last_peered":"2024-09-21T01:50:23.945600+0000","last_clean":"2024-09-21T01:50:23.945600+0000","last_became_active":"2024-09-21T01:50:22.935034+0000","last_became_peered":"2024-09-21T01:50:22.935034+0000","last_unstale":"2024-09-21T01:50:23.945600+0000","last_undegraded":"2024-09-21T01:50:23.945600+0000","last_fullsized":"2024-09-21T01:50:23.945600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:29:51.340786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.952354+0000","last_change":"2024-09-21T01:50:22.940999+0000","last_active":"2024-09-21T01:50:22.952354+0000","last_peered":"2024-09-21T01:50:22.952354+0000","last_clean":"2024-09-21T01:50:22.952354+0000","last_became_active":"2024-09-21T01:50:22.940703+0000","last_became_peered":"2024-09-21T01:50:22.940703+0000","last_unstale":"2024-09-21T01:50:22.952354+0000","last_undegraded":"2024-09-21T01:50:22.952354+0000","last_fullsized":"2024-09-21T01:50:22.952354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:07:45.686951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923272+0000","last_change":"2024-09-21T01:50:22.934969+0000","last_active":"2024-09-21T01:50:23.923272+0000","last_peered":"2024-09-21T01:50:23.923272+0000","last_clean":"2024-09-21T01:50:23.923272+0000","last_became_active":"2024-09-21T01:50:22.934597+0000","last_became_peered":"2024-09-21T01:50:22.934597+0000","last_unstale":"2024-09-21T01:50:23.923272+0000","last_undegraded":"2024-09-21T01:50:23.923272+0000","last_fullsized":"2024-09-21T01:50:23.923272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:02.635600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938540+0000","last_change":"2024-09-21T01:50:22.928871+0000","last_active":"2024-09-21T01:50:22.938540+0000","last_peered":"2024-09-21T01:50:22.938540+0000","last_clean":"2024-09-21T01:50:22.938540+0000","last_became_active":"2024-09-21T01:50:22.928542+0000","last_became_peered":"2024-09-21T01:50:22.928542+0000","last_unstale":"2024-09-21T01:50:22.938540+0000","last_undegraded":"2024-09-21T01:50:22.938540+0000","last_fullsized":"2024-09-21T01:50:22.938540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:13.451577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.946130+0000","last_change":"2024-09-21T01:50:22.935884+0000","last_active":"2024-09-21T01:50:23.946130+0000","last_peered":"2024-09-21T01:50:23.946130+0000","last_clean":"2024-09-21T01:50:23.946130+0000","last_became_active":"2024-09-21T01:50:22.935168+0000","last_became_peered":"2024-09-21T01:50:22.935168+0000","last_unstale":"2024-09-21T01:50:23.946130+0000","last_undegraded":"2024-09-21T01:50:23.946130+0000","last_fullsized":"2024-09-21T01:50:23.946130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:18.494639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922979+0000","last_change":"2024-09-21T01:50:22.935052+0000","last_active":"2024-09-21T01:50:23.922979+0000","last_peered":"2024-09-21T01:50:23.922979+0000","last_clean":"2024-09-21T01:50:23.922979+0000","last_became_active":"2024-09-21T01:50:22.934726+0000","last_became_peered":"2024-09-21T01:50:22.934726+0000","last_unstale":"2024-09-21T01:50:23.922979+0000","last_undegraded":"2024-09-21T01:50:23.922979+0000","last_fullsized":"2024-09-21T01:50:23.922979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:59:10.203132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943608+0000","last_change":"2024-09-21T01:50:22.943896+0000","last_active":"2024-09-21T01:50:23.943608+0000","last_peered":"2024-09-21T01:50:23.943608+0000","last_clean":"2024-09-21T01:50:23.943608+0000","last_became_active":"2024-09-21T01:50:22.943555+0000","last_became_peered":"2024-09-21T01:50:22.943555+0000","last_unstale":"2024-09-21T01:50:23.943608+0000","last_undegraded":"2024-09-21T01:50:23.943608+0000","last_fullsized":"2024-09-21T01:50:23.943608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:14.279845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944480+0000","last_change":"2024-09-21T01:50:22.944171+0000","last_active":"2024-09-21T01:50:23.944480+0000","last_peered":"2024-09-21T01:50:23.944480+0000","last_clean":"2024-09-21T01:50:23.944480+0000","last_became_active":"2024-09-21T01:50:22.943838+0000","last_became_peered":"2024-09-21T01:50:22.943838+0000","last_unstale":"2024-09-21T01:50:23.944480+0000","last_undegraded":"2024-09-21T01:50:23.944480+0000","last_fullsized":"2024-09-21T01:50:23.944480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:19.885742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943879+0000","last_change":"2024-09-21T01:50:22.943091+0000","last_active":"2024-09-21T01:50:23.943879+0000","last_peered":"2024-09-21T01:50:23.943879+0000","last_clean":"2024-09-21T01:50:23.943879+0000","last_became_active":"2024-09-21T01:50:22.942687+0000","last_became_peered":"2024-09-21T01:50:22.942687+0000","last_unstale":"2024-09-21T01:50:23.943879+0000","last_undegraded":"2024-09-21T01:50:23.943879+0000","last_fullsized":"2024-09-21T01:50:23.943879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:13.743137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.942884+0000","last_change":"2024-09-21T01:50:22.945935+0000","last_active":"2024-09-21T01:50:23.942884+0000","last_peered":"2024-09-21T01:50:23.942884+0000","last_clean":"2024-09-21T01:50:23.942884+0000","last_became_active":"2024-09-21T01:50:22.945643+0000","last_became_peered":"2024-09-21T01:50:22.945643+0000","last_unstale":"2024-09-21T01:50:23.942884+0000","last_undegraded":"2024-09-21T01:50:23.942884+0000","last_fullsized":"2024-09-21T01:50:23.942884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:15.775801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945104+0000","last_change":"2024-09-21T01:50:21.936573+0000","last_active":"2024-09-21T01:50:23.945104+0000","last_peered":"2024-09-21T01:50:23.945104+0000","last_clean":"2024-09-21T01:50:23.945104+0000","last_became_active":"2024-09-21T01:50:21.936223+0000","last_became_peered":"2024-09-21T01:50:21.936223+0000","last_unstale":"2024-09-21T01:50:23.945104+0000","last_undegraded":"2024-09-21T01:50:23.945104+0000","last_fullsized":"2024-09-21T01:50:23.945104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:56.999151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944705+0000","last_change":"2024-09-21T01:50:22.945483+0000","last_active":"2024-09-21T01:50:23.944705+0000","last_peered":"2024-09-21T01:50:23.944705+0000","last_clean":"2024-09-21T01:50:23.944705+0000","last_became_active":"2024-09-21T01:50:22.945151+0000","last_became_peered":"2024-09-21T01:50:22.945151+0000","last_unstale":"2024-09-21T01:50:23.944705+0000","last_undegraded":"2024-09-21T01:50:23.944705+0000","last_fullsized":"2024-09-21T01:50:23.944705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:57.762046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943041+0000","last_change":"2024-09-21T01:50:21.939207+0000","last_active":"2024-09-21T01:50:23.943041+0000","last_peered":"2024-09-21T01:50:23.943041+0000","last_clean":"2024-09-21T01:50:23.943041+0000","last_became_active":"2024-09-21T01:50:21.937960+0000","last_became_peered":"2024-09-21T01:50:21.937960+0000","last_unstale":"2024-09-21T01:50:23.943041+0000","last_undegraded":"2024-09-21T01:50:23.943041+0000","last_fullsized":"2024-09-21T01:50:23.943041+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:24.984117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922701+0000","last_change":"2024-09-21T01:50:22.937135+0000","last_active":"2024-09-21T01:50:23.922701+0000","last_peered":"2024-09-21T01:50:23.922701+0000","last_clean":"2024-09-21T01:50:23.922701+0000","last_became_active":"2024-09-21T01:50:22.936716+0000","last_became_peered":"2024-09-21T01:50:22.936716+0000","last_unstale":"2024-09-21T01:50:23.922701+0000","last_undegraded":"2024-09-21T01:50:23.922701+0000","last_fullsized":"2024-09-21T01:50:23.922701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:34.041532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922557+0000","last_change":"2024-09-21T01:50:21.940591+0000","last_active":"2024-09-21T01:50:23.922557+0000","last_peered":"2024-09-21T01:50:23.922557+0000","last_clean":"2024-09-21T01:50:23.922557+0000","last_became_active":"2024-09-21T01:50:21.940115+0000","last_became_peered":"2024-09-21T01:50:21.940115+0000","last_unstale":"2024-09-21T01:50:23.922557+0000","last_undegraded":"2024-09-21T01:50:23.922557+0000","last_fullsized":"2024-09-21T01:50:23.922557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:06.862534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.943518+0000","last_change":"2024-09-21T01:50:22.936600+0000","last_active":"2024-09-21T01:50:22.943518+0000","last_peered":"2024-09-21T01:50:22.943518+0000","last_clean":"2024-09-21T01:50:22.943518+0000","last_became_active":"2024-09-21T01:50:22.936304+0000","last_became_peered":"2024-09-21T01:50:22.936304+0000","last_unstale":"2024-09-21T01:50:22.943518+0000","last_undegraded":"2024-09-21T01:50:22.943518+0000","last_fullsized":"2024-09-21T01:50:22.943518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:30.189659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.948639+0000","last_change":"2024-09-21T01:50:21.932948+0000","last_active":"2024-09-21T01:50:22.948639+0000","last_peered":"2024-09-21T01:50:22.948639+0000","last_clean":"2024-09-21T01:50:22.948639+0000","last_became_active":"2024-09-21T01:50:21.932602+0000","last_became_peered":"2024-09-21T01:50:21.932602+0000","last_unstale":"2024-09-21T01:50:22.948639+0000","last_undegraded":"2024-09-21T01:50:22.948639+0000","last_fullsized":"2024-09-21T01:50:22.948639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:19:11.710237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943871+0000","last_change":"2024-09-21T01:50:22.934501+0000","last_active":"2024-09-21T01:50:23.943871+0000","last_peered":"2024-09-21T01:50:23.943871+0000","last_clean":"2024-09-21T01:50:23.943871+0000","last_became_active":"2024-09-21T01:50:22.934137+0000","last_became_peered":"2024-09-21T01:50:22.934137+0000","last_unstale":"2024-09-21T01:50:23.943871+0000","last_undegraded":"2024-09-21T01:50:23.943871+0000","last_fullsized":"2024-09-21T01:50:23.943871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:08.211941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923011+0000","last_change":"2024-09-21T01:50:21.935872+0000","last_active":"2024-09-21T01:50:23.923011+0000","last_peered":"2024-09-21T01:50:23.923011+0000","last_clean":"2024-09-21T01:50:23.923011+0000","last_became_active":"2024-09-21T01:50:21.935504+0000","last_became_peered":"2024-09-21T01:50:21.935504+0000","last_unstale":"2024-09-21T01:50:23.923011+0000","last_undegraded":"2024-09-21T01:50:23.923011+0000","last_fullsized":"2024-09-21T01:50:23.923011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:22.095398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945068+0000","last_change":"2024-09-21T01:50:22.942334+0000","last_active":"2024-09-21T01:50:23.945068+0000","last_peered":"2024-09-21T01:50:23.945068+0000","last_clean":"2024-09-21T01:50:23.945068+0000","last_became_active":"2024-09-21T01:50:22.942004+0000","last_became_peered":"2024-09-21T01:50:22.942004+0000","last_unstale":"2024-09-21T01:50:23.945068+0000","last_undegraded":"2024-09-21T01:50:23.945068+0000","last_fullsized":"2024-09-21T01:50:23.945068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:08.211941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922288+0000","last_change":"2024-09-21T01:50:21.935949+0000","last_active":"2024-09-21T01:50:23.922288+0000","last_peered":"2024-09-21T01:50:23.922288+0000","last_clean":"2024-09-21T01:50:23.922288+0000","last_became_active":"2024-09-21T01:50:21.935631+0000","last_became_peered":"2024-09-21T01:50:21.935631+0000","last_unstale":"2024-09-21T01:50:23.922288+0000","last_undegraded":"2024-09-21T01:50:23.922288+0000","last_fullsized":"2024-09-21T01:50:23.922288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:33.747031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922520+0000","last_change":"2024-09-21T01:50:22.937250+0000","last_active":"2024-09-21T01:50:23.922520+0000","last_peered":"2024-09-21T01:50:23.922520+0000","last_clean":"2024-09-21T01:50:23.922520+0000","last_became_active":"2024-09-21T01:50:22.936716+0000","last_became_peered":"2024-09-21T01:50:22.936716+0000","last_unstale":"2024-09-21T01:50:23.922520+0000","last_undegraded":"2024-09-21T01:50:23.922520+0000","last_fullsized":"2024-09-21T01:50:23.922520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:35:57.762046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922441+0000","last_change":"2024-09-21T01:50:21.933985+0000","last_active":"2024-09-21T01:50:23.922441+0000","last_peered":"2024-09-21T01:50:23.922441+0000","last_clean":"2024-09-21T01:50:23.922441+0000","last_became_active":"2024-09-21T01:50:21.933607+0000","last_became_peered":"2024-09-21T01:50:21.933607+0000","last_unstale":"2024-09-21T01:50:23.922441+0000","last_undegraded":"2024-09-21T01:50:23.922441+0000","last_fullsized":"2024-09-21T01:50:23.922441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:34.226552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.940062+0000","last_change":"2024-09-21T01:50:22.932093+0000","last_active":"2024-09-21T01:50:22.940062+0000","last_peered":"2024-09-21T01:50:22.940062+0000","last_clean":"2024-09-21T01:50:22.940062+0000","last_became_active":"2024-09-21T01:50:22.931766+0000","last_became_peered":"2024-09-21T01:50:22.931766+0000","last_unstale":"2024-09-21T01:50:22.940062+0000","last_undegraded":"2024-09-21T01:50:22.940062+0000","last_fullsized":"2024-09-21T01:50:22.940062+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:26.881009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922183+0000","last_change":"2024-09-21T01:50:21.929799+0000","last_active":"2024-09-21T01:50:23.922183+0000","last_peered":"2024-09-21T01:50:23.922183+0000","last_clean":"2024-09-21T01:50:23.922183+0000","last_became_active":"2024-09-21T01:50:21.929028+0000","last_became_peered":"2024-09-21T01:50:21.929028+0000","last_unstale":"2024-09-21T01:50:23.922183+0000","last_undegraded":"2024-09-21T01:50:23.922183+0000","last_fullsized":"2024-09-21T01:50:23.922183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:26.581913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945506+0000","last_change":"2024-09-21T01:50:22.933849+0000","last_active":"2024-09-21T01:50:23.945506+0000","last_peered":"2024-09-21T01:50:23.945506+0000","last_clean":"2024-09-21T01:50:23.945506+0000","last_became_active":"2024-09-21T01:50:22.933322+0000","last_became_peered":"2024-09-21T01:50:22.933322+0000","last_unstale":"2024-09-21T01:50:23.945506+0000","last_undegraded":"2024-09-21T01:50:23.945506+0000","last_fullsized":"2024-09-21T01:50:23.945506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:01.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922712+0000","last_change":"2024-09-21T01:50:21.940971+0000","last_active":"2024-09-21T01:50:23.922712+0000","last_peered":"2024-09-21T01:50:23.922712+0000","last_clean":"2024-09-21T01:50:23.922712+0000","last_became_active":"2024-09-21T01:50:21.940271+0000","last_became_peered":"2024-09-21T01:50:21.940271+0000","last_unstale":"2024-09-21T01:50:23.922712+0000","last_undegraded":"2024-09-21T01:50:23.922712+0000","last_fullsized":"2024-09-21T01:50:23.922712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:28.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922589+0000","last_change":"2024-09-21T01:50:22.937231+0000","last_active":"2024-09-21T01:50:23.922589+0000","last_peered":"2024-09-21T01:50:23.922589+0000","last_clean":"2024-09-21T01:50:23.922589+0000","last_became_active":"2024-09-21T01:50:22.936946+0000","last_became_peered":"2024-09-21T01:50:22.936946+0000","last_unstale":"2024-09-21T01:50:23.922589+0000","last_undegraded":"2024-09-21T01:50:23.922589+0000","last_fullsized":"2024-09-21T01:50:23.922589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:18.494639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943155+0000","last_change":"2024-09-21T01:50:21.933290+0000","last_active":"2024-09-21T01:50:23.943155+0000","last_peered":"2024-09-21T01:50:23.943155+0000","last_clean":"2024-09-21T01:50:23.943155+0000","last_became_active":"2024-09-21T01:50:21.932938+0000","last_became_peered":"2024-09-21T01:50:21.932938+0000","last_unstale":"2024-09-21T01:50:23.943155+0000","last_undegraded":"2024-09-21T01:50:23.943155+0000","last_fullsized":"2024-09-21T01:50:23.943155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:06.453555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922944+0000","last_change":"2024-09-21T01:50:22.934107+0000","last_active":"2024-09-21T01:50:23.922944+0000","last_peered":"2024-09-21T01:50:23.922944+0000","last_clean":"2024-09-21T01:50:23.922944+0000","last_became_active":"2024-09-21T01:50:22.933797+0000","last_became_peered":"2024-09-21T01:50:22.933797+0000","last_unstale":"2024-09-21T01:50:23.922944+0000","last_undegraded":"2024-09-21T01:50:23.922944+0000","last_fullsized":"2024-09-21T01:50:23.922944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:06.029662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945181+0000","last_change":"2024-09-21T01:50:21.938559+0000","last_active":"2024-09-21T01:50:23.945181+0000","last_peered":"2024-09-21T01:50:23.945181+0000","last_clean":"2024-09-21T01:50:23.945181+0000","last_became_active":"2024-09-21T01:50:21.938220+0000","last_became_peered":"2024-09-21T01:50:21.938220+0000","last_unstale":"2024-09-21T01:50:23.945181+0000","last_undegraded":"2024-09-21T01:50:23.945181+0000","last_fullsized":"2024-09-21T01:50:23.945181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:06.862534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945033+0000","last_change":"2024-09-21T01:50:22.950204+0000","last_active":"2024-09-21T01:50:23.945033+0000","last_peered":"2024-09-21T01:50:23.945033+0000","last_clean":"2024-09-21T01:50:23.945033+0000","last_became_active":"2024-09-21T01:50:22.949690+0000","last_became_peered":"2024-09-21T01:50:22.949690+0000","last_unstale":"2024-09-21T01:50:23.945033+0000","last_undegraded":"2024-09-21T01:50:23.945033+0000","last_fullsized":"2024-09-21T01:50:23.945033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:54.035962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922921+0000","last_change":"2024-09-21T01:50:21.940248+0000","last_active":"2024-09-21T01:50:23.922921+0000","last_peered":"2024-09-21T01:50:23.922921+0000","last_clean":"2024-09-21T01:50:23.922921+0000","last_became_active":"2024-09-21T01:50:21.939907+0000","last_became_peered":"2024-09-21T01:50:21.939907+0000","last_unstale":"2024-09-21T01:50:23.922921+0000","last_undegraded":"2024-09-21T01:50:23.922921+0000","last_fullsized":"2024-09-21T01:50:23.922921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:09.395017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.941936+0000","last_change":"2024-09-21T01:50:22.934816+0000","last_active":"2024-09-21T01:50:22.941936+0000","last_peered":"2024-09-21T01:50:22.941936+0000","last_clean":"2024-09-21T01:50:22.941936+0000","last_became_active":"2024-09-21T01:50:22.934507+0000","last_became_peered":"2024-09-21T01:50:22.934507+0000","last_unstale":"2024-09-21T01:50:22.941936+0000","last_undegraded":"2024-09-21T01:50:22.941936+0000","last_fullsized":"2024-09-21T01:50:22.941936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:38:37.025441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923108+0000","last_change":"2024-09-21T01:50:21.927104+0000","last_active":"2024-09-21T01:50:23.923108+0000","last_peered":"2024-09-21T01:50:23.923108+0000","last_clean":"2024-09-21T01:50:23.923108+0000","last_became_active":"2024-09-21T01:50:21.926790+0000","last_became_peered":"2024-09-21T01:50:21.926790+0000","last_unstale":"2024-09-21T01:50:23.923108+0000","last_undegraded":"2024-09-21T01:50:23.923108+0000","last_fullsized":"2024-09-21T01:50:23.923108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:45.025442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.923056+0000","last_change":"2024-09-21T01:50:22.943334+0000","last_active":"2024-09-21T01:50:23.923056+0000","last_peered":"2024-09-21T01:50:23.923056+0000","last_clean":"2024-09-21T01:50:23.923056+0000","last_became_active":"2024-09-21T01:50:22.942018+0000","last_became_peered":"2024-09-21T01:50:22.942018+0000","last_unstale":"2024-09-21T01:50:23.923056+0000","last_undegraded":"2024-09-21T01:50:23.923056+0000","last_fullsized":"2024-09-21T01:50:23.923056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:53:01.961942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.922215+0000","last_change":"2024-09-21T01:50:21.938167+0000","last_active":"2024-09-21T01:50:22.922215+0000","last_peered":"2024-09-21T01:50:22.922215+0000","last_clean":"2024-09-21T01:50:22.922215+0000","last_became_active":"2024-09-21T01:50:21.937222+0000","last_became_peered":"2024-09-21T01:50:21.937222+0000","last_unstale":"2024-09-21T01:50:22.922215+0000","last_undegraded":"2024-09-21T01:50:22.922215+0000","last_fullsized":"2024-09-21T01:50:22.922215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:19:00.285530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943781+0000","last_change":"2024-09-21T01:50:22.944481+0000","last_active":"2024-09-21T01:50:23.943781+0000","last_peered":"2024-09-21T01:50:23.943781+0000","last_clean":"2024-09-21T01:50:23.943781+0000","last_became_active":"2024-09-21T01:50:22.943841+0000","last_became_peered":"2024-09-21T01:50:22.943841+0000","last_unstale":"2024-09-21T01:50:23.943781+0000","last_undegraded":"2024-09-21T01:50:23.943781+0000","last_fullsized":"2024-09-21T01:50:23.943781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:00.475932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922259+0000","last_change":"2024-09-21T01:50:21.941591+0000","last_active":"2024-09-21T01:50:23.922259+0000","last_peered":"2024-09-21T01:50:23.922259+0000","last_clean":"2024-09-21T01:50:23.922259+0000","last_became_active":"2024-09-21T01:50:21.939995+0000","last_became_peered":"2024-09-21T01:50:21.939995+0000","last_unstale":"2024-09-21T01:50:23.922259+0000","last_undegraded":"2024-09-21T01:50:23.922259+0000","last_fullsized":"2024-09-21T01:50:23.922259+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:44.472563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944690+0000","last_change":"2024-09-21T01:50:22.938910+0000","last_active":"2024-09-21T01:50:23.944690+0000","last_peered":"2024-09-21T01:50:23.944690+0000","last_clean":"2024-09-21T01:50:23.944690+0000","last_became_active":"2024-09-21T01:50:22.938604+0000","last_became_peered":"2024-09-21T01:50:22.938604+0000","last_unstale":"2024-09-21T01:50:23.944690+0000","last_undegraded":"2024-09-21T01:50:23.944690+0000","last_fullsized":"2024-09-21T01:50:23.944690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:35.625465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922340+0000","last_change":"2024-09-21T01:50:21.937440+0000","last_active":"2024-09-21T01:50:23.922340+0000","last_peered":"2024-09-21T01:50:23.922340+0000","last_clean":"2024-09-21T01:50:23.922340+0000","last_became_active":"2024-09-21T01:50:21.936391+0000","last_became_peered":"2024-09-21T01:50:21.936391+0000","last_unstale":"2024-09-21T01:50:23.922340+0000","last_undegraded":"2024-09-21T01:50:23.922340+0000","last_fullsized":"2024-09-21T01:50:23.922340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:40.296960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922607+0000","last_change":"2024-09-21T01:50:22.933292+0000","last_active":"2024-09-21T01:50:23.922607+0000","last_peered":"2024-09-21T01:50:23.922607+0000","last_clean":"2024-09-21T01:50:23.922607+0000","last_became_active":"2024-09-21T01:50:22.932678+0000","last_became_peered":"2024-09-21T01:50:22.932678+0000","last_unstale":"2024-09-21T01:50:23.922607+0000","last_undegraded":"2024-09-21T01:50:23.922607+0000","last_fullsized":"2024-09-21T01:50:23.922607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:15.679550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.924200+0000","last_change":"2024-09-21T01:50:21.940550+0000","last_active":"2024-09-21T01:50:22.924200+0000","last_peered":"2024-09-21T01:50:22.924200+0000","last_clean":"2024-09-21T01:50:22.924200+0000","last_became_active":"2024-09-21T01:50:21.939857+0000","last_became_peered":"2024-09-21T01:50:21.939857+0000","last_unstale":"2024-09-21T01:50:22.924200+0000","last_undegraded":"2024-09-21T01:50:22.924200+0000","last_fullsized":"2024-09-21T01:50:22.924200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:32.943352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.946678+0000","last_change":"2024-09-21T01:50:22.934235+0000","last_active":"2024-09-21T01:50:23.946678+0000","last_peered":"2024-09-21T01:50:23.946678+0000","last_clean":"2024-09-21T01:50:23.946678+0000","last_became_active":"2024-09-21T01:50:22.933899+0000","last_became_peered":"2024-09-21T01:50:22.933899+0000","last_unstale":"2024-09-21T01:50:23.946678+0000","last_undegraded":"2024-09-21T01:50:23.946678+0000","last_fullsized":"2024-09-21T01:50:23.946678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:22.861515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922747+0000","last_change":"2024-09-21T01:50:21.929417+0000","last_active":"2024-09-21T01:50:23.922747+0000","last_peered":"2024-09-21T01:50:23.922747+0000","last_clean":"2024-09-21T01:50:23.922747+0000","last_became_active":"2024-09-21T01:50:21.929074+0000","last_became_peered":"2024-09-21T01:50:21.929074+0000","last_unstale":"2024-09-21T01:50:23.922747+0000","last_undegraded":"2024-09-21T01:50:23.922747+0000","last_fullsized":"2024-09-21T01:50:23.922747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:38.921120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.943546+0000","last_change":"2024-09-21T01:50:22.940192+0000","last_active":"2024-09-21T01:50:22.943546+0000","last_peered":"2024-09-21T01:50:22.943546+0000","last_clean":"2024-09-21T01:50:22.943546+0000","last_became_active":"2024-09-21T01:50:22.939898+0000","last_became_peered":"2024-09-21T01:50:22.939898+0000","last_unstale":"2024-09-21T01:50:22.943546+0000","last_undegraded":"2024-09-21T01:50:22.943546+0000","last_fullsized":"2024-09-21T01:50:22.943546+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:10:12.025425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922732+0000","last_change":"2024-09-21T01:50:21.933538+0000","last_active":"2024-09-21T01:50:23.922732+0000","last_peered":"2024-09-21T01:50:23.922732+0000","last_clean":"2024-09-21T01:50:23.922732+0000","last_became_active":"2024-09-21T01:50:21.933171+0000","last_became_peered":"2024-09-21T01:50:21.933171+0000","last_unstale":"2024-09-21T01:50:23.922732+0000","last_undegraded":"2024-09-21T01:50:23.922732+0000","last_fullsized":"2024-09-21T01:50:23.922732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:55:33.837036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938201+0000","last_change":"2024-09-21T01:50:22.934823+0000","last_active":"2024-09-21T01:50:22.938201+0000","last_peered":"2024-09-21T01:50:22.938201+0000","last_clean":"2024-09-21T01:50:22.938201+0000","last_became_active":"2024-09-21T01:50:22.934503+0000","last_became_peered":"2024-09-21T01:50:22.934503+0000","last_unstale":"2024-09-21T01:50:22.938201+0000","last_undegraded":"2024-09-21T01:50:22.938201+0000","last_fullsized":"2024-09-21T01:50:22.938201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:35.726572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922817+0000","last_change":"2024-09-21T01:50:21.933013+0000","last_active":"2024-09-21T01:50:23.922817+0000","last_peered":"2024-09-21T01:50:23.922817+0000","last_clean":"2024-09-21T01:50:23.922817+0000","last_became_active":"2024-09-21T01:50:21.932474+0000","last_became_peered":"2024-09-21T01:50:21.932474+0000","last_unstale":"2024-09-21T01:50:23.922817+0000","last_undegraded":"2024-09-21T01:50:23.922817+0000","last_fullsized":"2024-09-21T01:50:23.922817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:00:15.625865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.938302+0000","last_change":"2024-09-21T01:50:22.936551+0000","last_active":"2024-09-21T01:50:22.938302+0000","last_peered":"2024-09-21T01:50:22.938302+0000","last_clean":"2024-09-21T01:50:22.938302+0000","last_became_active":"2024-09-21T01:50:22.935715+0000","last_became_peered":"2024-09-21T01:50:22.935715+0000","last_unstale":"2024-09-21T01:50:22.938302+0000","last_undegraded":"2024-09-21T01:50:22.938302+0000","last_fullsized":"2024-09-21T01:50:22.938302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:33.041297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943655+0000","last_change":"2024-09-21T01:50:21.927714+0000","last_active":"2024-09-21T01:50:23.943655+0000","last_peered":"2024-09-21T01:50:23.943655+0000","last_clean":"2024-09-21T01:50:23.943655+0000","last_became_active":"2024-09-21T01:50:21.927328+0000","last_became_peered":"2024-09-21T01:50:21.927328+0000","last_unstale":"2024-09-21T01:50:23.943655+0000","last_undegraded":"2024-09-21T01:50:23.943655+0000","last_fullsized":"2024-09-21T01:50:23.943655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:28.643414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.942852+0000","last_change":"2024-09-21T01:50:22.941314+0000","last_active":"2024-09-21T01:50:22.942852+0000","last_peered":"2024-09-21T01:50:22.942852+0000","last_clean":"2024-09-21T01:50:22.942852+0000","last_became_active":"2024-09-21T01:50:22.941006+0000","last_became_peered":"2024-09-21T01:50:22.941006+0000","last_unstale":"2024-09-21T01:50:22.942852+0000","last_undegraded":"2024-09-21T01:50:22.942852+0000","last_fullsized":"2024-09-21T01:50:22.942852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:23.960853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944838+0000","last_change":"2024-09-21T01:50:21.937398+0000","last_active":"2024-09-21T01:50:23.944838+0000","last_peered":"2024-09-21T01:50:23.944838+0000","last_clean":"2024-09-21T01:50:23.944838+0000","last_became_active":"2024-09-21T01:50:21.937000+0000","last_became_peered":"2024-09-21T01:50:21.937000+0000","last_unstale":"2024-09-21T01:50:23.944838+0000","last_undegraded":"2024-09-21T01:50:23.944838+0000","last_fullsized":"2024-09-21T01:50:23.944838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:24.984117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.941146+0000","last_change":"2024-09-21T01:50:22.939195+0000","last_active":"2024-09-21T01:50:22.941146+0000","last_peered":"2024-09-21T01:50:22.941146+0000","last_clean":"2024-09-21T01:50:22.941146+0000","last_became_active":"2024-09-21T01:50:22.938885+0000","last_became_peered":"2024-09-21T01:50:22.938885+0000","last_unstale":"2024-09-21T01:50:22.941146+0000","last_undegraded":"2024-09-21T01:50:22.941146+0000","last_fullsized":"2024-09-21T01:50:22.941146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:39.435214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922054+0000","last_change":"2024-09-21T01:50:21.927988+0000","last_active":"2024-09-21T01:50:23.922054+0000","last_peered":"2024-09-21T01:50:23.922054+0000","last_clean":"2024-09-21T01:50:23.922054+0000","last_became_active":"2024-09-21T01:50:21.927672+0000","last_became_peered":"2024-09-21T01:50:21.927672+0000","last_unstale":"2024-09-21T01:50:23.922054+0000","last_undegraded":"2024-09-21T01:50:23.922054+0000","last_fullsized":"2024-09-21T01:50:23.922054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.881867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943764+0000","last_change":"2024-09-21T01:50:22.947890+0000","last_active":"2024-09-21T01:50:23.943764+0000","last_peered":"2024-09-21T01:50:23.943764+0000","last_clean":"2024-09-21T01:50:23.943764+0000","last_became_active":"2024-09-21T01:50:22.946023+0000","last_became_peered":"2024-09-21T01:50:22.946023+0000","last_unstale":"2024-09-21T01:50:23.943764+0000","last_undegraded":"2024-09-21T01:50:23.943764+0000","last_fullsized":"2024-09-21T01:50:23.943764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:31.229365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.945443+0000","last_change":"2024-09-21T01:50:21.937955+0000","last_active":"2024-09-21T01:50:23.945443+0000","last_peered":"2024-09-21T01:50:23.945443+0000","last_clean":"2024-09-21T01:50:23.945443+0000","last_became_active":"2024-09-21T01:50:21.937630+0000","last_became_peered":"2024-09-21T01:50:21.937630+0000","last_unstale":"2024-09-21T01:50:23.945443+0000","last_undegraded":"2024-09-21T01:50:23.945443+0000","last_fullsized":"2024-09-21T01:50:23.945443+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:28.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.944914+0000","last_change":"2024-09-21T01:50:22.942957+0000","last_active":"2024-09-21T01:50:22.944914+0000","last_peered":"2024-09-21T01:50:22.944914+0000","last_clean":"2024-09-21T01:50:22.944914+0000","last_became_active":"2024-09-21T01:50:22.942635+0000","last_became_peered":"2024-09-21T01:50:22.942635+0000","last_unstale":"2024-09-21T01:50:22.944914+0000","last_undegraded":"2024-09-21T01:50:22.944914+0000","last_fullsized":"2024-09-21T01:50:22.944914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:00.767514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.954302+0000","last_change":"2024-09-21T01:50:21.936422+0000","last_active":"2024-09-21T01:50:22.954302+0000","last_peered":"2024-09-21T01:50:22.954302+0000","last_clean":"2024-09-21T01:50:22.954302+0000","last_became_active":"2024-09-21T01:50:21.936098+0000","last_became_peered":"2024-09-21T01:50:21.936098+0000","last_unstale":"2024-09-21T01:50:22.954302+0000","last_undegraded":"2024-09-21T01:50:22.954302+0000","last_fullsized":"2024-09-21T01:50:22.954302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:08.922903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.946735+0000","last_change":"2024-09-21T01:50:22.953457+0000","last_active":"2024-09-21T01:50:23.946735+0000","last_peered":"2024-09-21T01:50:23.946735+0000","last_clean":"2024-09-21T01:50:23.946735+0000","last_became_active":"2024-09-21T01:50:22.953117+0000","last_became_peered":"2024-09-21T01:50:22.953117+0000","last_unstale":"2024-09-21T01:50:23.946735+0000","last_undegraded":"2024-09-21T01:50:23.946735+0000","last_fullsized":"2024-09-21T01:50:23.946735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:52.992315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943228+0000","last_change":"2024-09-21T01:50:21.928483+0000","last_active":"2024-09-21T01:50:23.943228+0000","last_peered":"2024-09-21T01:50:23.943228+0000","last_clean":"2024-09-21T01:50:23.943228+0000","last_became_active":"2024-09-21T01:50:21.928151+0000","last_became_peered":"2024-09-21T01:50:21.928151+0000","last_unstale":"2024-09-21T01:50:23.943228+0000","last_undegraded":"2024-09-21T01:50:23.943228+0000","last_fullsized":"2024-09-21T01:50:23.943228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:02.367816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.942900+0000","last_change":"2024-09-21T01:50:22.945039+0000","last_active":"2024-09-21T01:50:23.942900+0000","last_peered":"2024-09-21T01:50:23.942900+0000","last_clean":"2024-09-21T01:50:23.942900+0000","last_became_active":"2024-09-21T01:50:22.944709+0000","last_became_peered":"2024-09-21T01:50:22.944709+0000","last_unstale":"2024-09-21T01:50:23.942900+0000","last_undegraded":"2024-09-21T01:50:23.942900+0000","last_fullsized":"2024-09-21T01:50:23.942900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:10.398030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.923756+0000","last_change":"2024-09-21T01:50:21.937574+0000","last_active":"2024-09-21T01:50:22.923756+0000","last_peered":"2024-09-21T01:50:22.923756+0000","last_clean":"2024-09-21T01:50:22.923756+0000","last_became_active":"2024-09-21T01:50:21.937230+0000","last_became_peered":"2024-09-21T01:50:21.937230+0000","last_unstale":"2024-09-21T01:50:22.923756+0000","last_undegraded":"2024-09-21T01:50:22.923756+0000","last_fullsized":"2024-09-21T01:50:22.923756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:29.822079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944995+0000","last_change":"2024-09-21T01:50:22.941632+0000","last_active":"2024-09-21T01:50:23.944995+0000","last_peered":"2024-09-21T01:50:23.944995+0000","last_clean":"2024-09-21T01:50:23.944995+0000","last_became_active":"2024-09-21T01:50:22.941242+0000","last_became_peered":"2024-09-21T01:50:22.941242+0000","last_unstale":"2024-09-21T01:50:23.944995+0000","last_undegraded":"2024-09-21T01:50:23.944995+0000","last_fullsized":"2024-09-21T01:50:23.944995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:34.041532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943862+0000","last_change":"2024-09-21T01:50:21.936458+0000","last_active":"2024-09-21T01:50:23.943862+0000","last_peered":"2024-09-21T01:50:23.943862+0000","last_clean":"2024-09-21T01:50:23.943862+0000","last_became_active":"2024-09-21T01:50:21.936107+0000","last_became_peered":"2024-09-21T01:50:21.936107+0000","last_unstale":"2024-09-21T01:50:23.943862+0000","last_undegraded":"2024-09-21T01:50:23.943862+0000","last_fullsized":"2024-09-21T01:50:23.943862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:38.255635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943447+0000","last_change":"2024-09-21T01:50:22.949881+0000","last_active":"2024-09-21T01:50:23.943447+0000","last_peered":"2024-09-21T01:50:23.943447+0000","last_clean":"2024-09-21T01:50:23.943447+0000","last_became_active":"2024-09-21T01:50:22.949465+0000","last_became_peered":"2024-09-21T01:50:22.949465+0000","last_unstale":"2024-09-21T01:50:23.943447+0000","last_undegraded":"2024-09-21T01:50:23.943447+0000","last_fullsized":"2024-09-21T01:50:23.943447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:42.587312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-21T01:50:22.922453+0000","last_change":"2024-09-21T01:50:21.938652+0000","last_active":"2024-09-21T01:50:22.922453+0000","last_peered":"2024-09-21T01:50:22.922453+0000","last_clean":"2024-09-21T01:50:22.922453+0000","last_became_active":"2024-09-21T01:50:21.938240+0000","last_became_peered":"2024-09-21T01:50:21.938240+0000","last_unstale":"2024-09-21T01:50:22.922453+0000","last_undegraded":"2024-09-21T01:50:22.922453+0000","last_fullsized":"2024-09-21T01:50:22.922453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:47.328120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922259+0000","last_change":"2024-09-21T01:50:22.930528+0000","last_active":"2024-09-21T01:50:23.922259+0000","last_peered":"2024-09-21T01:50:23.922259+0000","last_clean":"2024-09-21T01:50:23.922259+0000","last_became_active":"2024-09-21T01:50:22.930082+0000","last_became_peered":"2024-09-21T01:50:22.930082+0000","last_unstale":"2024-09-21T01:50:23.922259+0000","last_undegraded":"2024-09-21T01:50:23.922259+0000","last_fullsized":"2024-09-21T01:50:23.922259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:29:51.340786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922175+0000","last_change":"2024-09-21T01:50:21.934955+0000","last_active":"2024-09-21T01:50:23.922175+0000","last_peered":"2024-09-21T01:50:23.922175+0000","last_clean":"2024-09-21T01:50:23.922175+0000","last_became_active":"2024-09-21T01:50:21.934527+0000","last_became_peered":"2024-09-21T01:50:21.934527+0000","last_unstale":"2024-09-21T01:50:23.922175+0000","last_undegraded":"2024-09-21T01:50:23.922175+0000","last_fullsized":"2024-09-21T01:50:23.922175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:46.497219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922168+0000","last_change":"2024-09-21T01:50:22.935496+0000","last_active":"2024-09-21T01:50:23.922168+0000","last_peered":"2024-09-21T01:50:23.922168+0000","last_clean":"2024-09-21T01:50:23.922168+0000","last_became_active":"2024-09-21T01:50:22.935097+0000","last_became_peered":"2024-09-21T01:50:22.935097+0000","last_unstale":"2024-09-21T01:50:23.922168+0000","last_undegraded":"2024-09-21T01:50:23.922168+0000","last_fullsized":"2024-09-21T01:50:23.922168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:35.625465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.922220+0000","last_change":"2024-09-21T01:50:21.937793+0000","last_active":"2024-09-21T01:50:23.922220+0000","last_peered":"2024-09-21T01:50:23.922220+0000","last_clean":"2024-09-21T01:50:23.922220+0000","last_became_active":"2024-09-21T01:50:21.936875+0000","last_became_peered":"2024-09-21T01:50:21.936875+0000","last_unstale":"2024-09-21T01:50:23.922220+0000","last_undegraded":"2024-09-21T01:50:23.922220+0000","last_fullsized":"2024-09-21T01:50:23.922220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:14.772788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944238+0000","last_change":"2024-09-21T01:50:22.937162+0000","last_active":"2024-09-21T01:50:23.944238+0000","last_peered":"2024-09-21T01:50:23.944238+0000","last_clean":"2024-09-21T01:50:23.944238+0000","last_became_active":"2024-09-21T01:50:22.936460+0000","last_became_peered":"2024-09-21T01:50:22.936460+0000","last_unstale":"2024-09-21T01:50:23.944238+0000","last_undegraded":"2024-09-21T01:50:23.944238+0000","last_fullsized":"2024-09-21T01:50:23.944238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:21.910398+0000","last_clean_scrub_stamp":"2024-09-21T01:50:21.910398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:01.160329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.943785+0000","last_change":"2024-09-21T01:50:21.932714+0000","last_active":"2024-09-21T01:50:23.943785+0000","last_peered":"2024-09-21T01:50:23.943785+0000","last_clean":"2024-09-21T01:50:23.943785+0000","last_became_active":"2024-09-21T01:50:21.932341+0000","last_became_peered":"2024-09-21T01:50:21.932341+0000","last_unstale":"2024-09-21T01:50:23.943785+0000","last_undegraded":"2024-09-21T01:50:23.943785+0000","last_fullsized":"2024-09-21T01:50:23.943785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:50:20.907385+0000","last_clean_scrub_stamp":"2024-09-21T01:50:20.907385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:33.747031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T01:50:23.944559+0000","last_change":"2024-09-21T01:49:29.995848+0000","last_active":"2024-09-21T01:50:23.944559+0000","last_peered":"2024-09-21T01:50:23.944559+0000","last_clean":"2024-09-21T01:50:23.944559+0000","last_became_active":"2024-09-21T01:49:29.994790+0000","last_became_peered":"2024-09-21T01:49:29.994790+0000","last_unstale":"2024-09-21T01:50:23.944559+0000","last_undegraded":"2024-09-21T01:50:23.944559+0000","last_fullsized":"2024-09-21T01:50:23.944559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:49:28.252238+0000","last_clean_scrub_stamp":"2024-09-21T01:49:28.252238+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:30.318506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":937984,"data_stored":719317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":129475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":129531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":348160,"data_stored":128963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":356352,"data_stored":130493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":719227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":122084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:50:27.390 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T01:50:27.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T01:50:27.457 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T01:50:27.457+0000 7f5dfb063640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T01:50:27.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.549+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/228456391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c806f4b0 msgr2=0x7fa9c80d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.549+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/228456391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c806f4b0 0x7fa9c80d3330 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80ba570 tx=0x7fa9bc02a4f0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.549+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/228456391 shutdown_connections 2024-09-21T01:50:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.549+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/228456391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c806f4b0 0x7fa9c80d3330 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.549+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/228456391 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa9c80d3870 0x7fa9c80ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.549+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/228456391 >> v2:172.21.15.139:3300/0 conn(0x7fa9c806e170 0x7fa9c80b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.549+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/228456391 >> 172.21.15.40:0/228456391 conn(0x7fa9c808bfc0 msgr2=0x7fa9c809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.550+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/228456391 shutdown_connections 2024-09-21T01:50:27.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.550+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/228456391 wait complete. 2024-09-21T01:50:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.551+0000 7fa9cf8ec640 1 Processor -- start 2024-09-21T01:50:27.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.551+0000 7fa9cf8ec640 1 -- start start 2024-09-21T01:50:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cf8ec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9c806f4b0 0x7fa9c815b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cf8ec640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa9c80d3870 0x7fa9c80b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cf8ec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c815f8f0 0x7fa9c80cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cf8ec640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c80cf490 con 0x7fa9c815f8f0 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cf8ec640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c80cf310 con 0x7fa9c806f4b0 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cf8ec640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c80d0ce0 con 0x7fa9c80d3870 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cde89640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c815f8f0 0x7fa9c80cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cde89640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c815f8f0 0x7fa9c80cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47630/0 (socket says 172.21.15.40:47630) 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cde89640 1 -- 172.21.15.40:0/2375547071 learned_addr learned my addr 172.21.15.40:0/2375547071 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cd688640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9c806f4b0 0x7fa9c815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cce87640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa9c80d3870 0x7fa9c80b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cde89640 1 -- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa9c80d3870 msgr2=0x7fa9c80b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cde89640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa9c80d3870 0x7fa9c80b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cde89640 1 -- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9c806f4b0 msgr2=0x7fa9c815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cde89640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9c806f4b0 0x7fa9c815b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cde89640 1 -- 172.21.15.40:0/2375547071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c80cc660 con 0x7fa9c815f8f0 2024-09-21T01:50:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9cde89640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c815f8f0 0x7fa9c80cd460 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000e990 tx=0x7fa9c000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9b9ffb640 1 -- 172.21.15.40:0/2375547071 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0004d20 con 0x7fa9c815f8f0 2024-09-21T01:50:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.553+0000 7fa9b9ffb640 1 -- 172.21.15.40:0/2375547071 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9c000cb00 con 0x7fa9c815f8f0 2024-09-21T01:50:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.554+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c815ee10 con 0x7fa9c815f8f0 2024-09-21T01:50:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.554+0000 7fa9b9ffb640 1 -- 172.21.15.40:0/2375547071 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0005020 con 0x7fa9c815f8f0 2024-09-21T01:50:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.554+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c815f3d0 con 0x7fa9c815f8f0 2024-09-21T01:50:27.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.555+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c80cc3d0 con 0x7fa9c815f8f0 2024-09-21T01:50:27.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.555+0000 7fa9b9ffb640 1 -- 172.21.15.40:0/2375547071 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa9c00051c0 con 0x7fa9c815f8f0 2024-09-21T01:50:27.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.556+0000 7fa9b9ffb640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa9ac078b90 0x7fa9ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:27.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.556+0000 7fa9b9ffb640 1 -- 172.21.15.40:0/2375547071 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa9c009b650 con 0x7fa9c815f8f0 2024-09-21T01:50:27.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.556+0000 7fa9cd688640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa9ac078b90 0x7fa9ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:27.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.557+0000 7fa9cd688640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa9ac078b90 0x7fa9ac07b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4005fd0 tx=0x7fa9c4005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:27.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.561+0000 7fa9b9ffb640 1 -- 172.21.15.40:0/2375547071 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa9c0016030 con 0x7fa9c815f8f0 2024-09-21T01:50:27.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.821+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa9c806e170 con 0x7fa9c815f8f0 2024-09-21T01:50:27.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.824+0000 7fa9b9ffb640 1 -- 172.21.15.40:0/2375547071 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fa9c0063a80 con 0x7fa9c815f8f0 2024-09-21T01:50:27.824 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-09-21T01:50:27.825 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD3Je5mKd0UCRAATv+wqTRVwprFAiJ5ouQBFA== 2024-09-21T01:50:27.825 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow" 2024-09-21T01:50:27.825 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow r" 2024-09-21T01:50:27.825 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T01:50:27.825 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2024-09-21T01:50:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa9ac078b90 msgr2=0x7fa9ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa9ac078b90 0x7fa9ac07b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4005fd0 tx=0x7fa9c4005850 comp rx=0 tx=0).stop 2024-09-21T01:50:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c815f8f0 msgr2=0x7fa9c80cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c815f8f0 0x7fa9c80cd460 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000e990 tx=0x7fa9c000ee50 comp rx=0 tx=0).stop 2024-09-21T01:50:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 shutdown_connections 2024-09-21T01:50:27.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7fa9ac078b90 0x7fa9ac07b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9c815f8f0 0x7fa9c80cd460 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7fa9c80d3870 0x7fa9c80b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 --2- 172.21.15.40:0/2375547071 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa9c806f4b0 0x7fa9c815b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 >> 172.21.15.40:0/2375547071 conn(0x7fa9c808bfc0 msgr2=0x7fa9c8161aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:27.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 shutdown_connections 2024-09-21T01:50:27.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.826+0000 7fa9cf8ec640 1 -- 172.21.15.40:0/2375547071 wait complete. 2024-09-21T01:50:27.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T01:50:27.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.995+0000 7f942e77b640 1 -- 172.21.15.40:0/1900759429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 msgr2=0x7f94280b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:27.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.995+0000 7f942e77b640 1 --2- 172.21.15.40:0/1900759429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 0x7f94280b63b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9410009830 tx=0x7f941002a510 comp rx=0 tx=0).stop 2024-09-21T01:50:27.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.995+0000 7f942e77b640 1 -- 172.21.15.40:0/1900759429 shutdown_connections 2024-09-21T01:50:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.995+0000 7f942e77b640 1 --2- 172.21.15.40:0/1900759429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 0x7f94280b63b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.995+0000 7f942e77b640 1 --2- 172.21.15.40:0/1900759429 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94280b9970 0x7f94280b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.995+0000 7f942e77b640 1 -- 172.21.15.40:0/1900759429 >> 172.21.15.40:0/1900759429 conn(0x7f942809d7f0 msgr2=0x7f94280d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.995+0000 7f942e77b640 1 -- 172.21.15.40:0/1900759429 shutdown_connections 2024-09-21T01:50:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.995+0000 7f942e77b640 1 -- 172.21.15.40:0/1900759429 wait complete. 2024-09-21T01:50:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.997+0000 7f942e77b640 1 Processor -- start 2024-09-21T01:50:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.997+0000 7f942e77b640 1 -- start start 2024-09-21T01:50:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.998+0000 7f942e77b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 0x7f94280ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.998+0000 7f942e77b640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94280b9970 0x7f942815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.998+0000 7f942e77b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94280ced80 0x7f94280b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.998+0000 7f942e77b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f942806f270 con 0x7f94280b5fa0 2024-09-21T01:50:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f942e77b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f942806f0f0 con 0x7f94280ced80 2024-09-21T01:50:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f942e77b640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f942806f3f0 con 0x7f94280b9970 2024-09-21T01:50:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f9427fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 0x7f94280ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f9427fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 0x7f94280ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47650/0 (socket says 172.21.15.40:47650) 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f9427fff640 1 -- 172.21.15.40:0/924948170 learned_addr learned my addr 172.21.15.40:0/924948170 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f941ffff640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94280b9970 0x7f942815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f942cd18640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94280ced80 0x7f94280b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f9427fff640 1 -- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94280b9970 msgr2=0x7f942815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f9427fff640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94280b9970 0x7f942815ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f9427fff640 1 -- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94280ced80 msgr2=0x7f94280b89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f9427fff640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94280ced80 0x7f94280b89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f9427fff640 1 -- 172.21.15.40:0/924948170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942815bf50 con 0x7f94280b5fa0 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f942cd18640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94280ced80 0x7f94280b89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f941ffff640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94280b9970 0x7f942815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f9427fff640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 0x7f94280ca380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f941800ea20 tx=0x7f941800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f94257fa640 1 -- 172.21.15.40:0/924948170 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941800cc60 con 0x7f94280b5fa0 2024-09-21T01:50:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f94257fa640 1 -- 172.21.15.40:0/924948170 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9418010430 con 0x7f94280b5fa0 2024-09-21T01:50:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94280cac80 con 0x7f94280b5fa0 2024-09-21T01:50:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f94257fa640 1 -- 172.21.15.40:0/924948170 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418010880 con 0x7f94280b5fa0 2024-09-21T01:50:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:27.999+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94281f5b60 con 0x7f94280b5fa0 2024-09-21T01:50:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.000+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94280cfc60 con 0x7f94280b5fa0 2024-09-21T01:50:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.001+0000 7f94257fa640 1 -- 172.21.15.40:0/924948170 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9418010a20 con 0x7f94280b5fa0 2024-09-21T01:50:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.002+0000 7f94257fa640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9408078b90 0x7f940807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.002+0000 7f94257fa640 1 -- 172.21.15.40:0/924948170 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f941809b7a0 con 0x7f94280b5fa0 2024-09-21T01:50:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.002+0000 7f941ffff640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9408078b90 0x7f940807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.003+0000 7f941ffff640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9408078b90 0x7f940807b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9410034000 tx=0x7f9410004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.006+0000 7f94257fa640 1 -- 172.21.15.40:0/924948170 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9418063c70 con 0x7f94280b5fa0 2024-09-21T01:50:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.235+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94281e7ff0 con 0x7f94280b5fa0 2024-09-21T01:50:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.235+0000 7f94257fa640 1 -- 172.21.15.40:0/924948170 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5223 (secure 0 0 0) 0x7f9418063570 con 0x7f94280b5fa0 2024-09-21T01:50:28.236 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:28.236 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"btime":"2024-09-21T01:50:25:944113+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6836/2199799930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":2199799930},{"type":"v1","addr":"172.21.15.139:6836","nonce":2199799930}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4813,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/989261762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6835","nonce":989261762},{"type":"v1","addr":"172.21.15.139:6837","nonce":989261762}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4819,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/452586017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":452586017},{"type":"v1","addr":"172.21.15.40:6835","nonce":452586017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:50:22.334764+0000","modified":"2024-09-21T01:50:25.327599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/2587661655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2587661655},{"type":"v1","addr":"172.21.15.40:6834","nonce":2587661655}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T01:50:28.237 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 17 2024-09-21T01:50:28.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.237+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9408078b90 msgr2=0x7f940807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.237+0000 7f942e77b640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9408078b90 0x7f940807b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9410034000 tx=0x7f9410004730 comp rx=0 tx=0).stop 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.237+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 msgr2=0x7f94280ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.238+0000 7f942e77b640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 0x7f94280ca380 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f941800ea20 tx=0x7f941800eee0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.238+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 shutdown_connections 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.238+0000 7f942e77b640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f9408078b90 0x7f940807b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.238+0000 7f942e77b640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94280ced80 0x7f94280b89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.238+0000 7f942e77b640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f94280b9970 0x7f942815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.238+0000 7f942e77b640 1 --2- 172.21.15.40:0/924948170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94280b5fa0 0x7f94280ca380 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.238+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 >> 172.21.15.40:0/924948170 conn(0x7f942809d7f0 msgr2=0x7f94280b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.238+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 shutdown_connections 2024-09-21T01:50:28.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.238+0000 7f942e77b640 1 -- 172.21.15.40:0/924948170 wait complete. 2024-09-21T01:50:28.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T01:50:22.334764+0000', 'modified': '2024-09-21T01:50:25.327599+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4902}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4902': {'gid': 4902, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6834/2587661655', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 2587661655}, {'type': 'v1', 'addr': '172.21.15.40:6834', 'nonce': 2587661655}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4902, 'qdb_cluster': [4902]} 2024-09-21T01:50:28.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T01:50:28.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T01:50:28.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.777+0000 7f4b0f00e640 1 -- 172.21.15.40:0/116802572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 msgr2=0x7f4b0806f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.777+0000 7f4b0f00e640 1 --2- 172.21.15.40:0/116802572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 0x7f4b0806f7a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4b0808c950 tx=0x7f4af002a5f0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.777+0000 7f4b0f00e640 1 -- 172.21.15.40:0/116802572 shutdown_connections 2024-09-21T01:50:28.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.777+0000 7f4b0f00e640 1 --2- 172.21.15.40:0/116802572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 0x7f4b0806f7a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.777+0000 7f4b0f00e640 1 --2- 172.21.15.40:0/116802572 >> v2:172.21.15.139:3300/0 conn(0x7f4b080b3a60 0x7f4b080cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.777+0000 7f4b0f00e640 1 -- 172.21.15.40:0/116802572 >> 172.21.15.40:0/116802572 conn(0x7f4b0808bfc0 msgr2=0x7f4b0809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:28.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.777+0000 7f4b0f00e640 1 -- 172.21.15.40:0/116802572 shutdown_connections 2024-09-21T01:50:28.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.777+0000 7f4b0f00e640 1 -- 172.21.15.40:0/116802572 wait complete. 2024-09-21T01:50:28.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.779+0000 7f4b0f00e640 1 Processor -- start 2024-09-21T01:50:28.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.779+0000 7f4b0f00e640 1 -- start start 2024-09-21T01:50:28.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0f00e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 0x7f4b080a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0f00e640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b080b3a60 0x7f4b08161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0f00e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b080d0e10 0x7f4b08161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0f00e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4b080d2c40 con 0x7f4b0806e3c0 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0f00e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4b080d2ac0 con 0x7f4b080d0e10 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0f00e640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f4b080d2dc0 con 0x7f4b080b3a60 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0cdaa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 0x7f4b080a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0cdaa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 0x7f4b080a1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47666/0 (socket says 172.21.15.40:47666) 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0cdaa640 1 -- 172.21.15.40:0/3302954242 learned_addr learned my addr 172.21.15.40:0/3302954242 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b080b3a60 0x7f4b08161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0d5ab640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b080d0e10 0x7f4b08161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0cdaa640 1 -- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b080b3a60 msgr2=0x7f4b08161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b080b3a60 0x7f4b08161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0cdaa640 1 -- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b080d0e10 msgr2=0x7f4b08161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b080d0e10 0x7f4b08161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0cdaa640 1 -- 172.21.15.40:0/3302954242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b08153fb0 con 0x7f4b0806e3c0 2024-09-21T01:50:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 0x7f4b080a1b70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4af800e790 tx=0x7f4af800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.781+0000 7f4b057fa640 1 -- 172.21.15.40:0/3302954242 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af800eea0 con 0x7f4b0806e3c0 2024-09-21T01:50:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.782+0000 7f4b057fa640 1 -- 172.21.15.40:0/3302954242 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4af800cdb0 con 0x7f4b0806e3c0 2024-09-21T01:50:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.782+0000 7f4b057fa640 1 -- 172.21.15.40:0/3302954242 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8010690 con 0x7f4b0806e3c0 2024-09-21T01:50:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.782+0000 7f4b0f00e640 1 -- 172.21.15.40:0/3302954242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b080b5fc0 con 0x7f4b0806e3c0 2024-09-21T01:50:28.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.782+0000 7f4b0f00e640 1 -- 172.21.15.40:0/3302954242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b080b6580 con 0x7f4b0806e3c0 2024-09-21T01:50:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.784+0000 7f4b057fa640 1 -- 172.21.15.40:0/3302954242 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4af8010830 con 0x7f4b0806e3c0 2024-09-21T01:50:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.784+0000 7f4b057fa640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4ae8078bc0 0x7f4ae807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.784+0000 7f4b057fa640 1 -- 172.21.15.40:0/3302954242 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4af809b660 con 0x7f4b0806e3c0 2024-09-21T01:50:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.784+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4ae8078bc0 0x7f4ae807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.785+0000 7f4b1605a740 1 Processor -- start 2024-09-21T01:50:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.785+0000 7f4b1605a740 1 -- start start 2024-09-21T01:50:28.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.785+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4ae8078bc0 0x7f4ae807b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4af0033000 tx=0x7f4af0004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8befa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 0x55940e8bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4cc590 0x55940e8dc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b1605a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55940e807820 con 0x55940e4ed270 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b1605a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55940e7f6c50 con 0x55940e4cc590 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b1605a740 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x55940e7faa60 con 0x55940e4c43b0 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b0cdaa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b0cdaa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8befa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47672/0 (socket says 172.21.15.40:47672) 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b0cdaa640 1 -- 172.21.15.40:0/3285721289 learned_addr learned my addr 172.21.15.40:0/3285721289 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b0d5ab640 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4cc590 0x55940e8dc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 0x55940e8bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b0cdaa640 1 -- 172.21.15.40:0/3285721289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 msgr2=0x55940e8bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.786+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 0x55940e8bf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.787+0000 7f4b0cdaa640 1 -- 172.21.15.40:0/3285721289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4cc590 msgr2=0x55940e8dc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.787+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4cc590 0x55940e8dc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.787+0000 7f4b0cdaa640 1 -- 172.21.15.40:0/3285721289 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940e558850 con 0x55940e4ed270 2024-09-21T01:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.787+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 0x55940e8bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.787+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8befa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4af8063260 tx=0x7f4af8062fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72be0b1eeaa1d1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.787+0000 7f4afe7fc640 1 -- 172.21.15.40:0/3285721289 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8067f10 con 0x55940e4ed270 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.787+0000 7f4afe7fc640 1 -- 172.21.15.40:0/3285721289 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4af806cdc0 con 0x55940e4ed270 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.787+0000 7f4afe7fc640 1 -- 172.21.15.40:0/3285721289 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8085da0 con 0x55940e4ed270 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.788+0000 7f4b1605a740 1 -- 172.21.15.40:0/3285721289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 msgr2=0x55940e8befa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.788+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8befa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4af8063260 tx=0x7f4af8062fe0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.788+0000 7f4b1605a740 1 -- 172.21.15.40:0/3285721289 shutdown_connections 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.788+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4cc590 0x55940e8dc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.788+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 0x55940e8bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.788+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3285721289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8befa0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.788+0000 7f4b1605a740 1 -- 172.21.15.40:0/3285721289 >> 172.21.15.40:0/3285721289 conn(0x55940e4e13c0 msgr2=0x55940e895260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:28.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.788+0000 7f4b1605a740 1 -- 172.21.15.40:0/3285721289 shutdown_connections 2024-09-21T01:50:28.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.788+0000 7f4b1605a740 1 -- 172.21.15.40:0/3285721289 wait complete. 2024-09-21T01:50:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.789+0000 7f4b1605a740 1 -- start start 2024-09-21T01:50:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.789+0000 7f4b1605a740 1 Processor -- start 2024-09-21T01:50:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 0x55940e8d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8e8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4ed270 0x55940e8dc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b1605a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55940e567620 con 0x55940e4cc590 2024-09-21T01:50:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b1605a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55940e79c5f0 con 0x55940e4ed270 2024-09-21T01:50:28.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b1605a740 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x55940e8bfa20 con 0x55940e4c43b0 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b1605a740 10 client.0 _ll_register_callbacks cb 0x55940e7a00a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8e8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8e8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47686/0 (socket says 172.21.15.40:47686) 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b07fff640 1 -- 172.21.15.40:0/4141825159 learned_addr learned my addr 172.21.15.40:0/4141825159 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 0x55940e8d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.790+0000 7f4b0d5ab640 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4ed270 0x55940e8dc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4b07fff640 1 -- 172.21.15.40:0/4141825159 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 msgr2=0x55940e8d2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4b07fff640 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 0x55940e8d2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4b07fff640 1 -- 172.21.15.40:0/4141825159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4ed270 msgr2=0x55940e8dc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4b07fff640 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4ed270 0x55940e8dc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4b07fff640 1 -- 172.21.15.40:0/4141825159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55940e5cf6b0 con 0x55940e4cc590 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4b07fff640 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8e8ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4af0034040 tx=0x7f4af0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909bb50cfaaa5ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4ae77fe640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4ae77fe640 1 -- 172.21.15.40:0/4141825159 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af004d070 con 0x55940e4cc590 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4ae77fe640 1 -- 172.21.15.40:0/4141825159 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4af0003b80 con 0x55940e4cc590 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4b1605a740 1 -- 172.21.15.40:0/4141825159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4af806cdc0 con 0x55940e4cc590 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4ae77fe640 1 -- 172.21.15.40:0/4141825159 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4af0058050 con 0x55940e4cc590 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4b1605a740 10 client.5064 fetch_fsmap learned FSMap version 17 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4b1605a740 1 -- 172.21.15.40:0/4141825159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55940e8e8ff0 con 0x55940e4cc590 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.791+0000 7f4ae77fe640 1 -- 172.21.15.40:0/4141825159 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4af806cdc0 con 0x55940e4cc590 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4ae77fe640 1 -- 172.21.15.40:0/4141825159 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f4af005b020 con 0x55940e4cc590 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4b1605a740 10 client.5064 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4b1605a740 10 client.5064 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4b1605a740 20 client.5064 populate_metadata read hostname 'smithi040' 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4b1605a740 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] conn(0x55940e4abe40 0x55940e8d4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4b1605a740 4 client.5064 mds_command: new command op to 4902 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4b1605a740 1 -- 172.21.15.40:0/4141825159 --> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55940e809770 con 0x55940e4abe40 2024-09-21T01:50:28.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] conn(0x55940e4abe40 0x55940e8d4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4ae77fe640 10 client.5064 ms_handle_connect on v2:172.21.15.40:6832/2587661655 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.792+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] conn(0x55940e4abe40 0x55940e8d4550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfdbf09d01b6f805 server_cookie=26f1669249450772 in_seq=0 out_seq=0 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4ae77fe640 1 -- 172.21.15.40:0/4141825159 <== mds.0 v2:172.21.15.40:6832/2587661655 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55940e809770 con 0x55940e4abe40 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4ae77fe640 10 client.5064 handle_command_reply: tid=0 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 client.5064 shutdown 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 -- 172.21.15.40:0/4141825159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 msgr2=0x55940e8e8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8e8ab0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4af0034040 tx=0x7f4af0009260 comp rx=0 tx=0).stop 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 -- 172.21.15.40:0/4141825159 shutdown_connections 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] conn(0x55940e4abe40 0x55940e8d4550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4ed270 0x55940e8dc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8e8ab0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4ae77fe640 0 client.5064 ms_handle_reset on v2:172.21.15.40:6832/2587661655 2024-09-21T01:50:28.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 --2- 172.21.15.40:0/4141825159 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4c43b0 0x55940e8d2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 -- 172.21.15.40:0/4141825159 >> 172.21.15.40:0/4141825159 conn(0x55940e4e13c0 msgr2=0x55940e88f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 -- 172.21.15.40:0/4141825159 shutdown_connections 2024-09-21T01:50:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.793+0000 7f4b1605a740 1 -- 172.21.15.40:0/4141825159 wait complete. 2024-09-21T01:50:28.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.794+0000 7f4b1605a740 20 client.5064 trim_cache size 0 max 16384 2024-09-21T01:50:28.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.812+0000 7f4b1605a740 1 Processor -- start 2024-09-21T01:50:28.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.812+0000 7f4b1605a740 1 -- start start 2024-09-21T01:50:28.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.813+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e8bb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.813+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.813+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4ed270 0x55940e8fd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.813+0000 7f4b1605a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08201170 con 0x55940e4cc590 2024-09-21T01:50:28.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.813+0000 7f4b1605a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08152230 con 0x55940e4c43b0 2024-09-21T01:50:28.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.813+0000 7f4b1605a740 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f4b08152880 con 0x55940e4ed270 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.813+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.813+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8fcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47688/0 (socket says 172.21.15.40:47688) 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b07fff640 1 -- 172.21.15.40:0/3893688448 learned_addr learned my addr 172.21.15.40:0/3893688448 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e8bb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b0d5ab640 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4ed270 0x55940e8fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b07fff640 1 -- 172.21.15.40:0/3893688448 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4ed270 msgr2=0x55940e8fd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4ed270 0x55940e8fd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b07fff640 1 -- 172.21.15.40:0/3893688448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 msgr2=0x55940e8bb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e8bb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b07fff640 1 -- 172.21.15.40:0/3893688448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55940e892790 con 0x55940e4cc590 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e8bb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8fcc50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4af002abe0 tx=0x7f4af0005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de24ff3b256c1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4afdffb640 1 -- 172.21.15.40:0/3893688448 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0062070 con 0x55940e4cc590 2024-09-21T01:50:28.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4afdffb640 1 -- 172.21.15.40:0/3893688448 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4af00049e0 con 0x55940e4cc590 2024-09-21T01:50:28.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.814+0000 7f4afdffb640 1 -- 172.21.15.40:0/3893688448 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af004d070 con 0x55940e4cc590 2024-09-21T01:50:28.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.815+0000 7f4b1605a740 1 -- 172.21.15.40:0/3893688448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 msgr2=0x55940e8fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.815+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8fcc50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4af002abe0 tx=0x7f4af0005560 comp rx=0 tx=0).stop 2024-09-21T01:50:28.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.815+0000 7f4b1605a740 1 -- 172.21.15.40:0/3893688448 shutdown_connections 2024-09-21T01:50:28.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.815+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4ed270 0x55940e8fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.815+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4cc590 0x55940e8fcc50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.815+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3893688448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e8bb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.815+0000 7f4b1605a740 1 -- 172.21.15.40:0/3893688448 >> 172.21.15.40:0/3893688448 conn(0x55940e4e13c0 msgr2=0x55940e890ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.815+0000 7f4b1605a740 1 -- 172.21.15.40:0/3893688448 shutdown_connections 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.815+0000 7f4b1605a740 1 -- 172.21.15.40:0/3893688448 wait complete. 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.816+0000 7f4b1605a740 1 -- start start 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.816+0000 7f4b1605a740 1 Processor -- start 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e9533a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4cc590 0x55940e8acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b1605a740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8beb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b1605a740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55940e8a22f0 con 0x55940e4ed270 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b1605a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55940e8d5560 con 0x55940e4c43b0 2024-09-21T01:50:28.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b1605a740 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x55940e8dd6b0 con 0x55940e4cc590 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b1605a740 10 client.0 _ll_register_callbacks cb 0x7f4af0040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b0d5ab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8beb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b0d5ab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8beb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47700/0 (socket says 172.21.15.40:47700) 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.817+0000 7f4b0d5ab640 1 -- 172.21.15.40:0/3649958496 learned_addr learned my addr 172.21.15.40:0/3649958496 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e9533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4cc590 0x55940e8acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b0d5ab640 1 -- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4cc590 msgr2=0x55940e8acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b0d5ab640 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4cc590 0x55940e8acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b0d5ab640 1 -- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 msgr2=0x55940e9533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b0d5ab640 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e9533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b0d5ab640 1 -- 172.21.15.40:0/3649958496 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55940e8d6500 con 0x55940e4ed270 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e9533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:28.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b07fff640 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4cc590 0x55940e8acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b0d5ab640 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8beb70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4b0806e320 tx=0x7f4b00005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec5787a51bee77f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4ae77fe640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4ae77fe640 1 -- 172.21.15.40:0/3649958496 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00006d60 con 0x55940e4ed270 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4ae77fe640 1 -- 172.21.15.40:0/3649958496 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4b000175b0 con 0x55940e4ed270 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b1605a740 1 -- 172.21.15.40:0/3649958496 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4af00049e0 con 0x55940e4ed270 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4ae77fe640 1 -- 172.21.15.40:0/3649958496 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4b00027050 con 0x55940e4ed270 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b1605a740 10 client.5070 fetch_fsmap learned FSMap version 17 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4b1605a740 1 -- 172.21.15.40:0/3649958496 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55940e8ad2a0 con 0x55940e4ed270 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.818+0000 7f4ae77fe640 1 -- 172.21.15.40:0/3649958496 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4af00049e0 con 0x55940e4ed270 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4ae77fe640 1 -- 172.21.15.40:0/3649958496 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f4b0002a020 con 0x55940e4ed270 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4b1605a740 10 client.5070 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4b1605a740 10 client.5070 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4b1605a740 20 client.5070 populate_metadata read hostname 'smithi040' 2024-09-21T01:50:28.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] conn(0x55940e88e200 0x55940e88e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4b1605a740 4 client.5070 mds_command: new command op to 4902 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4b1605a740 1 -- 172.21.15.40:0/3649958496 --> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] -- command(tid 0: {"prefix": "status"}) -- 0x55940e8d0220 con 0x55940e88e200 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] conn(0x55940e88e200 0x55940e88e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4ae77fe640 10 client.5070 ms_handle_connect on v2:172.21.15.40:6832/2587661655 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4b0cdaa640 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] conn(0x55940e88e200 0x55940e88e610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b863ee606fe2df5 server_cookie=440ca53e2437ca52 in_seq=0 out_seq=0 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4ae77fe640 1 -- 172.21.15.40:0/3649958496 <== mds.0 v2:172.21.15.40:6832/2587661655 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55940e8d0220 con 0x55940e88e200 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4ae77fe640 10 client.5070 handle_command_reply: tid=0 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.819+0000 7f4b1605a740 1 client.5070 shutdown 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 -- 172.21.15.40:0/3649958496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 msgr2=0x55940e8beb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8beb70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4b0806e320 tx=0x7f4b00005420 comp rx=0 tx=0).stop 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 -- 172.21.15.40:0/3649958496 shutdown_connections 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.40:6832/2587661655,v1:172.21.15.40:6834/2587661655] conn(0x55940e88e200 0x55940e88e610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55940e4ed270 0x55940e8beb70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x55940e4cc590 0x55940e8acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 --2- 172.21.15.40:0/3649958496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55940e4c43b0 0x55940e9533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4ae77fe640 0 client.5070 ms_handle_reset on v2:172.21.15.40:6832/2587661655 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 -- 172.21.15.40:0/3649958496 >> 172.21.15.40:0/3649958496 conn(0x55940e4e13c0 msgr2=0x55940e88f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 -- 172.21.15.40:0/3649958496 shutdown_connections 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 1 -- 172.21.15.40:0/3649958496 wait complete. 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b1605a740 20 client.5070 trim_cache size 0 max 16384 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "52e0e71c-26ee-4828-88d9-740be2c186cd", 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4902, 2024-09-21T01:50:28.826 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-21T01:50:28.827 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-21T01:50:28.827 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-21T01:50:28.827 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 5.9027098660000004, 2024-09-21T01:50:28.827 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 17, 2024-09-21T01:50:28.827 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 32, 2024-09-21T01:50:28.827 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 32, 2024-09-21T01:50:28.827 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 13.199538696999999 2024-09-21T01:50:28.827 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 -- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4ae8078bc0 msgr2=0x7f4ae807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4ae8078bc0 0x7f4ae807b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4af0033000 tx=0x7f4af0004730 comp rx=0 tx=0).stop 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 -- 172.21.15.40:0/3302954242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 msgr2=0x7f4b080a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 0x7f4b080a1b70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4af800e790 tx=0x7f4af800ec50 comp rx=0 tx=0).stop 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 -- 172.21.15.40:0/3302954242 shutdown_connections 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f4ae8078bc0 0x7f4ae807b0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b080d0e10 0x7f4b08161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f4b080b3a60 0x7f4b08161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 --2- 172.21.15.40:0/3302954242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b0806e3c0 0x7f4b080a1b70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.820+0000 7f4b0f00e640 1 -- 172.21.15.40:0/3302954242 >> 172.21.15.40:0/3302954242 conn(0x7f4b0808bfc0 msgr2=0x7f4b080d4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.821+0000 7f4b0f00e640 1 -- 172.21.15.40:0/3302954242 shutdown_connections 2024-09-21T01:50:28.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.821+0000 7f4b0f00e640 1 -- 172.21.15.40:0/3302954242 wait complete. 2024-09-21T01:50:28.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T01:50:28.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.948+0000 7ff6ef020640 1 -- 172.21.15.40:0/2971548840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 msgr2=0x7ff6e80cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.948+0000 7ff6ef020640 1 --2- 172.21.15.40:0/2971548840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 0x7ff6e80cebf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8073f50 tx=0x7ff6e002aac0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.948+0000 7ff6ef020640 1 -- 172.21.15.40:0/2971548840 shutdown_connections 2024-09-21T01:50:28.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.948+0000 7ff6ef020640 1 --2- 172.21.15.40:0/2971548840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 0x7ff6e80cebf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.948+0000 7ff6ef020640 1 --2- 172.21.15.40:0/2971548840 >> v2:172.21.15.139:3300/0 conn(0x7ff6e80b51c0 0x7ff6e815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.948+0000 7ff6ef020640 1 -- 172.21.15.40:0/2971548840 >> 172.21.15.40:0/2971548840 conn(0x7ff6e8072ae0 msgr2=0x7ff6e8072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:28.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.948+0000 7ff6ef020640 1 -- 172.21.15.40:0/2971548840 shutdown_connections 2024-09-21T01:50:28.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.948+0000 7ff6ef020640 1 -- 172.21.15.40:0/2971548840 wait complete. 2024-09-21T01:50:28.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.950+0000 7ff6ef020640 1 Processor -- start 2024-09-21T01:50:28.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.950+0000 7ff6ef020640 1 -- start start 2024-09-21T01:50:28.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ef020640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6e80b51c0 0x7ff6e8147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ef020640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6e80ccbd0 0x7ff6e81583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ef020640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 0x7ff6e80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ef020640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e80cf2b0 con 0x7ff6e80d1490 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ef020640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e80cf130 con 0x7ff6e80ccbd0 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ef020640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e80cf430 con 0x7ff6e80b51c0 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ed5bd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 0x7ff6e80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ed5bd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 0x7ff6e80cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47724/0 (socket says 172.21.15.40:47724) 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ed5bd640 1 -- 172.21.15.40:0/2861301650 learned_addr learned my addr 172.21.15.40:0/2861301650 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ecdbc640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6e80b51c0 0x7ff6e8147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6e7fff640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6e80ccbd0 0x7ff6e81583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ed5bd640 1 -- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6e80b51c0 msgr2=0x7ff6e8147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ed5bd640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6e80b51c0 0x7ff6e8147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ed5bd640 1 -- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6e80ccbd0 msgr2=0x7ff6e81583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ed5bd640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6e80ccbd0 0x7ff6e81583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ed5bd640 1 -- 172.21.15.40:0/2861301650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e81483c0 con 0x7ff6e80d1490 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.952+0000 7ff6ed5bd640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 0x7ff6e80cb5c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009d60 tx=0x7ff6e0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.953+0000 7ff6e57fa640 1 -- 172.21.15.40:0/2861301650 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0044070 con 0x7ff6e80d1490 2024-09-21T01:50:28.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.953+0000 7ff6e57fa640 1 -- 172.21.15.40:0/2861301650 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6e0003e50 con 0x7ff6e80d1490 2024-09-21T01:50:28.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.953+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e80ca800 con 0x7ff6e80d1490 2024-09-21T01:50:28.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.953+0000 7ff6e57fa640 1 -- 172.21.15.40:0/2861301650 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e00044b0 con 0x7ff6e80d1490 2024-09-21T01:50:28.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.953+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e80cadc0 con 0x7ff6e80d1490 2024-09-21T01:50:28.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.954+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e814b3c0 con 0x7ff6e80d1490 2024-09-21T01:50:28.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.954+0000 7ff6e57fa640 1 -- 172.21.15.40:0/2861301650 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff6e0004650 con 0x7ff6e80d1490 2024-09-21T01:50:28.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.955+0000 7ff6e57fa640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff6cc078b90 0x7ff6cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:50:28.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.955+0000 7ff6e57fa640 1 -- 172.21.15.40:0/2861301650 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff6e00bb350 con 0x7ff6e80d1490 2024-09-21T01:50:28.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.955+0000 7ff6ecdbc640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff6cc078b90 0x7ff6cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:50:28.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.956+0000 7ff6ecdbc640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff6cc078b90 0x7ff6cc07b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009b30 tx=0x7ff6dc005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:50:28.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:28.960+0000 7ff6e57fa640 1 -- 172.21.15.40:0/2861301650 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff6e0032030 con 0x7ff6e80d1490 2024-09-21T01:50:29.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.186+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff6e80cf880 con 0x7ff6e80d1490 2024-09-21T01:50:29.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.186+0000 7ff6e57fa640 1 -- 172.21.15.40:0/2861301650 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7ff6e0083140 con 0x7ff6e80d1490 2024-09-21T01:50:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T01:50:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff6cc078b90 msgr2=0x7ff6cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff6cc078b90 0x7ff6cc07b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009b30 tx=0x7ff6dc005f90 comp rx=0 tx=0).stop 2024-09-21T01:50:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 msgr2=0x7ff6e80cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:50:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 0x7ff6e80cb5c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009d60 tx=0x7ff6e0003ce0 comp rx=0 tx=0).stop 2024-09-21T01:50:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 shutdown_connections 2024-09-21T01:50:29.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7ff6cc078b90 0x7ff6cc07b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:29.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e80d1490 0x7ff6e80cb5c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:29.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6e80ccbd0 0x7ff6e81583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:29.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 --2- 172.21.15.40:0/2861301650 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7ff6e80b51c0 0x7ff6e8147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:50:29.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.188+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 >> 172.21.15.40:0/2861301650 conn(0x7ff6e8072ae0 msgr2=0x7ff6e80b7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:50:29.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.189+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 shutdown_connections 2024-09-21T01:50:29.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29.189+0000 7ff6ef020640 1 -- 172.21.15.40:0/2861301650 wait complete. 2024-09-21T01:50:29.200 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T01:50:29.201 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T01:50:29.201 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-21T01:50:29.201 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T01:50:29.201 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T01:50:29.201 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T01:50:29.201 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T01:50:29.201 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T01:50:29.201 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:50:29.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:29.201 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-21T01:50:29.217 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:29.218 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42748sec preferred_lft 42748sec 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 1a:57:57:c5:8d:7f brd ff:ff:ff:ff:ff:ff 2024-09-21T01:50:29.219 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::7069:13ff:fed7:c068/64 scope link 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 1a:57:57:c5:8d:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::1857:57ff:fec5:8d7f/64 scope link 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 26:8a:cc:b4:5f:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::248a:ccff:feb4:5f4d/64 scope link 2024-09-21T01:50:29.220 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:50:29.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:29.221 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T01:50:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-21T01:50:29.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:29.283 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-21T01:50:29.340 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-21T01:50:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T01:50:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T01:50:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T01:50:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T01:50:29.341 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:50:29.341 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-21T01:50:29.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T01:50:29.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T01:50:29.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T01:50:29.341 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-21T01:50:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:50:29.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:29.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:29.471 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-21T01:50:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T01:50:29.487 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T01:50:29.488 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:50:29.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:29.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-09-21T01:50:29.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:50:29.554 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T01:50:29.609 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:50:29.610 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:50:29.610 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:50:29.665 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T01:50:29.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:29.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:50:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:50:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:50:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T01:50:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T01:50:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.139:3300,172.21.15.139:3301" 2024-09-21T01:50:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 0@52e0e71c-26ee-4828-88d9-740be2c186cd.cephfs=/ 2024-09-21T01:50:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.40:3300/172.21.15.139:3300/172.21.15.139:3301" will pass to kernel 2024-09-21T01:50:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T01:50:29.783 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2024-09-21T01:50:29.783 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T01:50:29.783 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T01:50:29.783 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T01:50:29.784 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T01:50:29.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:29.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:50:29.811 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T01:50:29.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:50:29.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:50:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:50:29.915 INFO:teuthology.orchestra.run.smithi040.stdout:client4966 2024-09-21T01:50:29.915 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:50:29.916 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:50:29.932 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=xfstests-dev 2024-09-21T01:50:29.988 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.9vjfAyR2gpxfstests-dev 2024-09-21T01:50:29.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:29.989 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.9vjfAyR2gpxfstests-dev) 2024-09-21T01:50:30.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:30.056 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.9vjfAyR2gpxfstests-dev) 2024-09-21T01:50:30.116 INFO:teuthology.orchestra.run.smithi040.stderr:Cloning into '/tmp/tmp.9vjfAyR2gpxfstests-dev'... 2024-09-21T01:50:30.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:30.789 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-09-21T01:50:30.849 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=test 2024-09-21T01:50:30.905 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.30uH4J1k1ztest 2024-09-21T01:50:30.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:50:30.906 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-09-21T01:50:30.963 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=scratch 2024-09-21T01:50:31.019 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:50:31.019 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9.stream". 2024-09-21T01:50:31.019 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-09-21T01:50:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:03:20 ago on Sat 21 Sep 2024 01:47:11 AM UTC. 2024-09-21T01:50:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:50:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:50:31.770 INFO:teuthology.orchestra.run.smithi040.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-09-21T01:50:31.771 INFO:teuthology.orchestra.run.smithi040.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-09-21T01:50:31.772 INFO:teuthology.orchestra.run.smithi040.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-09-21T01:50:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-09-21T01:50:31.776 INFO:teuthology.orchestra.run.smithi040.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-09-21T01:50:31.777 INFO:teuthology.orchestra.run.smithi040.stdout:Package gcc-11.5.0-2.el9.x86_64 is already installed. 2024-09-21T01:50:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:Package git-2.43.5-1.el9.x86_64 is already installed. 2024-09-21T01:50:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:50:31.782 INFO:teuthology.orchestra.run.smithi040.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-09-21T01:50:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:Package libtool-2.4.6-46.el9.x86_64 is already installed. 2024-09-21T01:50:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:Package libuuid-devel-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:50:31.787 INFO:teuthology.orchestra.run.smithi040.stdout:Package lvm2-9:2.03.24-2.el9.x86_64 is already installed. 2024-09-21T01:50:31.788 INFO:teuthology.orchestra.run.smithi040.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-09-21T01:50:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-09-21T01:50:31.790 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-3.9.19-8.el9.x86_64 is already installed. 2024-09-21T01:50:31.791 INFO:teuthology.orchestra.run.smithi040.stdout:Package quota-1:4.09-2.el9.x86_64 is already installed. 2024-09-21T01:50:31.792 INFO:teuthology.orchestra.run.smithi040.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-09-21T01:50:31.795 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:50:31.843 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-09-21T01:50:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-21T01:50:31.844 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-09-21T01:50:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-21T01:50:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-devel x86_64 5.14.0-508.el9 appstream 20 M 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-09-21T01:50:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:Install 16 Packages 2024-09-21T01:50:31.846 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:50:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 28 M 2024-09-21T01:50:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 80 M 2024-09-21T01:50:31.847 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-09-21T01:50:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:(1/16): fio-engine-http-3.35-1.el9.x86_64.rpm 202 kB/s | 18 kB 00:00 2024-09-21T01:50:32.270 INFO:teuthology.orchestra.run.smithi040.stdout:(2/16): fio-engine-libaio-3.35-1.el9.x86_64.rpm 469 kB/s | 16 kB 00:00 2024-09-21T01:50:32.303 INFO:teuthology.orchestra.run.smithi040.stdout:(3/16): fio-engine-nbd-3.35-1.el9.x86_64.rpm 436 kB/s | 15 kB 00:00 2024-09-21T01:50:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:(4/16): fio-engine-rados-3.35-1.el9.x86_64.rpm 471 kB/s | 16 kB 00:00 2024-09-21T01:50:32.371 INFO:teuthology.orchestra.run.smithi040.stdout:(5/16): fio-engine-rbd-3.35-1.el9.x86_64.rpm 486 kB/s | 16 kB 00:00 2024-09-21T01:50:32.455 INFO:teuthology.orchestra.run.smithi040.stdout:(6/16): fio-3.35-1.el9.x86_64.rpm 20 MB/s | 6.2 MB 00:00 2024-09-21T01:50:32.479 INFO:teuthology.orchestra.run.smithi040.stdout:(7/16): fio-engine-rdma-3.35-1.el9.x86_64.rpm 190 kB/s | 21 kB 00:00 2024-09-21T01:50:32.538 INFO:teuthology.orchestra.run.smithi040.stdout:(8/16): rmt-1.6-6.el9.x86_64.rpm 118 kB/s | 46 kB 00:00 2024-09-21T01:50:32.563 INFO:teuthology.orchestra.run.smithi040.stdout:(9/16): libcap-devel-2.48-9.el9.x86_64.rpm 485 kB/s | 41 kB 00:00 2024-09-21T01:50:32.822 INFO:teuthology.orchestra.run.smithi040.stdout:(10/16): kernel-devel-5.14.0-508.el9.x86_64.rpm 55 MB/s | 20 MB 00:00 2024-09-21T01:50:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:(11/16): sqlite-3.34.1-7.el9.x86_64.rpm 2.6 MB/s | 748 kB 00:00 2024-09-21T01:50:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:(12/16): udftools-2.2-5.el9.x86_64.rpm 482 kB/s | 149 kB 00:00 2024-09-21T01:50:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:(13/16): dump-0.4-0.51.b47.el9.x86_64.rpm 1.7 MB/s | 88 kB 00:00 2024-09-21T01:50:32.957 INFO:teuthology.orchestra.run.smithi040.stdout:(14/16): indent-2.2.13-5.el9.x86_64.rpm 5.2 MB/s | 179 kB 00:00 2024-09-21T01:50:33.124 INFO:teuthology.orchestra.run.smithi040.stdout:(15/16): gdbm-1.23-1.el9.x86_64.rpm 508 kB/s | 153 kB 00:00 2024-09-21T01:50:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:(16/16): gdbm-devel-1.23-1.el9.x86_64.rpm 175 kB/s | 81 kB 00:00 2024-09-21T01:50:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:50:33.309 INFO:teuthology.orchestra.run.smithi040.stdout:Total 19 MB/s | 28 MB 00:01 2024-09-21T01:50:33.656 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-09-21T01:50:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-09-21T01:50:33.721 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-09-21T01:50:34.363 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-09-21T01:50:34.363 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-09-21T01:50:35.326 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-09-21T01:50:35.376 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 1/16 2024-09-21T01:50:35.401 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 2/16 2024-09-21T01:50:35.426 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 3/16 2024-09-21T01:50:35.452 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 4/16 2024-09-21T01:50:35.477 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 5/16 2024-09-21T01:50:35.637 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 6/16 2024-09-21T01:50:35.683 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-3.35-1.el9.x86_64 7/16 2024-09-21T01:50:35.717 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 8/16 2024-09-21T01:50:35.754 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rmt-2:1.6-6.el9.x86_64 9/16 2024-09-21T01:50:35.784 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 10/16 2024-09-21T01:50:35.838 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 11/16 2024-09-21T01:50:35.878 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : indent-2.2.13-5.el9.x86_64 12/16 2024-09-21T01:50:35.918 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : udftools-2.2-5.el9.x86_64 13/16 2024-09-21T01:50:35.977 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 14/16 2024-09-21T01:50:36.311 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:50:36.314 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:50:46.130 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 15/16 2024-09-21T01:50:46.410 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-devel-5.14.0-508.el9.x86_64 16/16 2024-09-21T01:50:59.661 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-devel-5.14.0-508.el9.x86_64 16/16 2024-09-21T01:50:59.661 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/16 2024-09-21T01:50:59.661 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-3.35-1.el9.x86_64 2/16 2024-09-21T01:50:59.661 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-devel-5.14.0-508.el9.x86_64 9/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 11/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : udftools-2.2-5.el9.x86_64 12/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 13/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 14/16 2024-09-21T01:50:59.662 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 15/16 2024-09-21T01:51:00.166 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : indent-2.2.13-5.el9.x86_64 16/16 2024-09-21T01:51:00.166 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:51:00.166 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-09-21T01:51:00.166 INFO:teuthology.orchestra.run.smithi040.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-09-21T01:51:00.166 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-09-21T01:51:00.167 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-09-21T01:51:00.167 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-09-21T01:51:00.167 INFO:teuthology.orchestra.run.smithi040.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-09-21T01:51:00.167 INFO:teuthology.orchestra.run.smithi040.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-508.el9.x86_64 2024-09-21T01:51:00.167 INFO:teuthology.orchestra.run.smithi040.stdout: libcap-devel-2.48-9.el9.x86_64 rmt-2:1.6-6.el9.x86_64 2024-09-21T01:51:00.167 INFO:teuthology.orchestra.run.smithi040.stdout: sqlite-3.34.1-7.el9.x86_64 udftools-2.2-5.el9.x86_64 2024-09-21T01:51:00.167 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:51:00.167 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-09-21T01:51:00.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd -m fsgqa 2024-09-21T01:51:00.587 INFO:teuthology.orchestra.run.smithi040.stderr:useradd: user 'fsgqa' already exists 2024-09-21T01:51:00.589 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-09-21T01:51:00.589 DEBUG:teuthology.orchestra.run.smithi040:> sudo groupadd fsgqa 2024-09-21T01:51:00.655 INFO:teuthology.orchestra.run.smithi040.stderr:groupadd: group 'fsgqa' already exists 2024-09-21T01:51:00.657 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-09-21T01:51:00.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd fsgqa2 2024-09-21T01:51:01.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd 123456-fsgqa 2024-09-21T01:51:02.197 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-09-21T01:51:02.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.327+0000 7f700905c640 1 -- 172.21.15.40:0/242197849 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f70040cfb00 msgr2=0x7f700415bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:02.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.327+0000 7f700905c640 1 --2- 172.21.15.40:0/242197849 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f70040cfb00 0x7f700415bf20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009830 tx=0x7f6ff402a510 comp rx=0 tx=0).stop 2024-09-21T01:51:02.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.327+0000 7f700905c640 1 -- 172.21.15.40:0/242197849 shutdown_connections 2024-09-21T01:51:02.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.327+0000 7f700905c640 1 --2- 172.21.15.40:0/242197849 >> v2:172.21.15.139:3300/0 conn(0x7f70040ccba0 0x7f70040cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.327+0000 7f700905c640 1 --2- 172.21.15.40:0/242197849 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f70040cfb00 0x7f700415bf20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.327+0000 7f700905c640 1 -- 172.21.15.40:0/242197849 >> 172.21.15.40:0/242197849 conn(0x7f70040b1cb0 msgr2=0x7f70040b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.327+0000 7f700905c640 1 -- 172.21.15.40:0/242197849 shutdown_connections 2024-09-21T01:51:02.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.327+0000 7f700905c640 1 -- 172.21.15.40:0/242197849 wait complete. 2024-09-21T01:51:02.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.329+0000 7f700905c640 1 Processor -- start 2024-09-21T01:51:02.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.329+0000 7f700905c640 1 -- start start 2024-09-21T01:51:02.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700905c640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f70040ccba0 0x7f70040c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700905c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70040ccfb0 0x7f70041f7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700905c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70040cfb00 0x7f70040c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700905c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7004070830 con 0x7f70040cfb00 2024-09-21T01:51:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700905c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f70040706b0 con 0x7f70040ccfb0 2024-09-21T01:51:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700905c640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f70040ca9a0 con 0x7f70040ccba0 2024-09-21T01:51:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70040cfb00 0x7f70040c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70040cfb00 0x7f70040c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36216/0 (socket says 172.21.15.40:36216) 2024-09-21T01:51:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700359e640 1 -- 172.21.15.40:0/2614300139 learned_addr learned my addr 172.21.15.40:0/2614300139 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:51:02.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f7002d9d640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f70040ccba0 0x7f70040c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700259c640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70040ccfb0 0x7f70041f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700359e640 1 -- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f70040ccba0 msgr2=0x7f70040c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700359e640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f70040ccba0 0x7f70040c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700359e640 1 -- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70040ccfb0 msgr2=0x7f70041f7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700359e640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70040ccfb0 0x7f70041f7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700359e640 1 -- 172.21.15.40:0/2614300139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70041f3c50 con 0x7f70040cfb00 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700259c640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70040ccfb0 0x7f70041f7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.331+0000 7f700359e640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70040cfb00 0x7f70040c5e30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00cb10 tx=0x7f6ffc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.332+0000 7f6feb7fe640 1 -- 172.21.15.40:0/2614300139 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc016020 con 0x7f70040cfb00 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.332+0000 7f6feb7fe640 1 -- 172.21.15.40:0/2614300139 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ffc00ad60 con 0x7f70040cfb00 2024-09-21T01:51:02.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.332+0000 7f6feb7fe640 1 -- 172.21.15.40:0/2614300139 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc012680 con 0x7f70040cfb00 2024-09-21T01:51:02.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.332+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70041f3f30 con 0x7f70040cfb00 2024-09-21T01:51:02.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.332+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70041f44f0 con 0x7f70040cfb00 2024-09-21T01:51:02.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.333+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70040cf160 con 0x7f70040cfb00 2024-09-21T01:51:02.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.334+0000 7f6feb7fe640 1 -- 172.21.15.40:0/2614300139 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ffc019020 con 0x7f70040cfb00 2024-09-21T01:51:02.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.334+0000 7f6feb7fe640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6ff0078bc0 0x7f6ff007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:02.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.334+0000 7f6feb7fe640 1 -- 172.21.15.40:0/2614300139 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6ffc09b060 con 0x7f70040cfb00 2024-09-21T01:51:02.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.334+0000 7f7002d9d640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6ff0078bc0 0x7f6ff007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:02.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.335+0000 7f7002d9d640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6ff0078bc0 0x7f6ff007b0d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4034000 tx=0x7f6ff4004730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:02.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.339+0000 7f6feb7fe640 1 -- 172.21.15.40:0/2614300139 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6ffc020030 con 0x7f70040cfb00 2024-09-21T01:51:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.606+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f70040b5320 con 0x7f70040cfb00 2024-09-21T01:51:02.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.606+0000 7f6feb7fe640 1 -- 172.21.15.40:0/2614300139 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7f6ffc0634a0 con 0x7f70040cfb00 2024-09-21T01:51:02.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:51:02.608 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":1,"fsid":"52e0e71c-26ee-4828-88d9-740be2c186cd","modified":"2024-09-21T01:48:38.010608Z","created":"2024-09-21T01:48:38.010608Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3301","nonce":0},{"type":"v1","addr":"172.21.15.139:6790","nonce":0}]},"addr":"172.21.15.139:6790/0","public_addr":"172.21.15.139:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T01:51:02.608 INFO:teuthology.orchestra.run.smithi040.stderr:dumped monmap epoch 1 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6ff0078bc0 msgr2=0x7f6ff007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6ff0078bc0 0x7f6ff007b0d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4034000 tx=0x7f6ff4004730 comp rx=0 tx=0).stop 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70040cfb00 msgr2=0x7f70040c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70040cfb00 0x7f70040c5e30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00cb10 tx=0x7f6ffc00a060 comp rx=0 tx=0).stop 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 shutdown_connections 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f6ff0078bc0 0x7f6ff007b0d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70040cfb00 0x7f70040c5e30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70040ccfb0 0x7f70041f7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 --2- 172.21.15.40:0/2614300139 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f70040ccba0 0x7f70040c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 >> 172.21.15.40:0/2614300139 conn(0x7f70040b1cb0 msgr2=0x7f70040b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 shutdown_connections 2024-09-21T01:51:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.609+0000 7f700905c640 1 -- 172.21.15.40:0/2614300139 wait complete. 2024-09-21T01:51:02.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-09-21T01:51:02.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.738+0000 7f43d39a8640 1 -- 172.21.15.40:0/1106162180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 msgr2=0x7f43cc0b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:02.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.738+0000 7f43d39a8640 1 --2- 172.21.15.40:0/1106162180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 0x7f43cc0b40b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005fd0 tx=0x7f43bc02a5d0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.738+0000 7f43d39a8640 1 -- 172.21.15.40:0/1106162180 shutdown_connections 2024-09-21T01:51:02.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.738+0000 7f43d39a8640 1 --2- 172.21.15.40:0/1106162180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 0x7f43cc0b40b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.738+0000 7f43d39a8640 1 --2- 172.21.15.40:0/1106162180 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43cc0cc1e0 0x7f43cc0af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.738+0000 7f43d39a8640 1 -- 172.21.15.40:0/1106162180 >> 172.21.15.40:0/1106162180 conn(0x7f43cc06d7d0 msgr2=0x7f43cc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:02.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.738+0000 7f43d39a8640 1 -- 172.21.15.40:0/1106162180 shutdown_connections 2024-09-21T01:51:02.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.738+0000 7f43d39a8640 1 -- 172.21.15.40:0/1106162180 wait complete. 2024-09-21T01:51:02.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.740+0000 7f43d39a8640 1 Processor -- start 2024-09-21T01:51:02.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.740+0000 7f43d39a8640 1 -- start start 2024-09-21T01:51:02.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.741+0000 7f43d39a8640 1 --2- >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43cc0cc1e0 0x7f43cc09d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:02.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.741+0000 7f43d39a8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43cc0ccb50 0x7f43cc15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:02.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.741+0000 7f43d39a8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 0x7f43cc0ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.741+0000 7f43d39a8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc153520 con 0x7f43cc15d8a0 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.741+0000 7f43d39a8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc1533a0 con 0x7f43cc0ccb50 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.741+0000 7f43d39a8640 1 -- --> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc1536a0 con 0x7f43cc0cc1e0 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.741+0000 7f43d1f45640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 0x7f43cc0ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.741+0000 7f43d1f45640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 0x7f43cc0ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36226/0 (socket says 172.21.15.40:36226) 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.741+0000 7f43d1f45640 1 -- 172.21.15.40:0/2231347197 learned_addr learned my addr 172.21.15.40:0/2231347197 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43d0f43640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43cc0ccb50 0x7f43cc15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43d1744640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43cc0cc1e0 0x7f43cc09d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43d1f45640 1 -- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43cc0cc1e0 msgr2=0x7f43cc09d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43d1f45640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43cc0cc1e0 0x7f43cc09d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43d1f45640 1 -- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43cc0ccb50 msgr2=0x7f43cc15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43d1f45640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43cc0ccb50 0x7f43cc15c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43d1f45640 1 -- 172.21.15.40:0/2231347197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc1f94e0 con 0x7f43cc15d8a0 2024-09-21T01:51:02.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43d1f45640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 0x7f43cc0ae110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c760 tx=0x7f43c400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:02.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43c1ffb640 1 -- 172.21.15.40:0/2231347197 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4003da0 con 0x7f43cc15d8a0 2024-09-21T01:51:02.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43c1ffb640 1 -- 172.21.15.40:0/2231347197 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43c400ce10 con 0x7f43cc15d8a0 2024-09-21T01:51:02.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc1f97c0 con 0x7f43cc15d8a0 2024-09-21T01:51:02.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.742+0000 7f43c1ffb640 1 -- 172.21.15.40:0/2231347197 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c40052d0 con 0x7f43cc15d8a0 2024-09-21T01:51:02.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.743+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc1f9d80 con 0x7f43cc15d8a0 2024-09-21T01:51:02.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.744+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc153b50 con 0x7f43cc15d8a0 2024-09-21T01:51:02.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.745+0000 7f43c1ffb640 1 -- 172.21.15.40:0/2231347197 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43c4005470 con 0x7f43cc15d8a0 2024-09-21T01:51:02.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.745+0000 7f43c1ffb640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f43b0078b90 0x7f43b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:02.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.745+0000 7f43c1ffb640 1 -- 172.21.15.40:0/2231347197 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f43c409a930 con 0x7f43cc15d8a0 2024-09-21T01:51:02.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.745+0000 7f43d1744640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f43b0078b90 0x7f43b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:02.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.746+0000 7f43d1744640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f43b0078b90 0x7f43b007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f43c800a490 tx=0x7f43c800a420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:02.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:02.753+0000 7f43c1ffb640 1 -- 172.21.15.40:0/2231347197 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f43c40627b0 con 0x7f43cc15d8a0 2024-09-21T01:51:03.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.039+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f43cc0b20c0 con 0x7f43cc15d8a0 2024-09-21T01:51:03.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.039+0000 7f43c1ffb640 1 -- 172.21.15.40:0/2231347197 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) ==== 92+0+63 (secure 0 0 0) 0x7f43c40671e0 con 0x7f43cc15d8a0 2024-09-21T01:51:03.040 INFO:teuthology.orchestra.run.smithi040.stdout:[client.admin] 2024-09-21T01:51:03.040 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== 2024-09-21T01:51:03.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f43b0078b90 msgr2=0x7f43b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:03.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f43b0078b90 0x7f43b007b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f43c800a490 tx=0x7f43c800a420 comp rx=0 tx=0).stop 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 msgr2=0x7f43cc0ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 0x7f43cc0ae110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43c400c760 tx=0x7f43c400cc20 comp rx=0 tx=0).stop 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 shutdown_connections 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:6800/852736644,v1:172.21.15.139:6801/852736644] conn(0x7f43b0078b90 0x7f43b007b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc15d8a0 0x7f43cc0ae110 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43cc0ccb50 0x7f43cc15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 --2- 172.21.15.40:0/2231347197 >> [v2:172.21.15.139:3301/0,v1:172.21.15.139:6790/0] conn(0x7f43cc0cc1e0 0x7f43cc09d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.041+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 >> 172.21.15.40:0/2231347197 conn(0x7f43cc06d7d0 msgr2=0x7f43cc0d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.042+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 shutdown_connections 2024-09-21T01:51:03.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-21T01:51:03.042+0000 7f43d39a8640 1 -- 172.21.15.40:0/2231347197 wait complete. 2024-09-21T01:51:03.054 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:51:03.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.9vjfAyR2gpxfstests-dev/local.config 2024-09-21T01:51:03.080 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.40:6789:/test export TEST_DIR=/tmp/tmp.30uH4J1k1ztest export SCRATCH_DEV=172.21.15.40:6789:/scratch export SCRATCH_MNT=/tmp/tmp.j6CdXJYUQdscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA==" 2024-09-21T01:51:03.080 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-21T01:51:03.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.9vjfAyR2gpxfstests-dev/ceph.exclude 2024-09-21T01:51:03.146 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo make) 2024-09-21T01:51:03.223 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize -cfi 2024-09-21T01:51:03.645 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-21T01:51:03.646 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.guess' 2024-09-21T01:51:03.649 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.sub' 2024-09-21T01:51:03.653 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './install-sh' 2024-09-21T01:51:03.657 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './ltmain.sh' 2024-09-21T01:51:03.679 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-21T01:51:03.680 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-21T01:51:03.684 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-21T01:51:03.689 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-21T01:51:03.693 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-21T01:51:03.698 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-21T01:51:03.704 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-21T01:51:03.705 INFO:teuthology.orchestra.run.smithi040.stdout:cp include/install-sh . 2024-09-21T01:51:03.706 INFO:teuthology.orchestra.run.smithi040.stdout:aclocal -I m4 2024-09-21T01:51:04.736 INFO:teuthology.orchestra.run.smithi040.stdout:autoheader 2024-09-21T01:51:05.038 INFO:teuthology.orchestra.run.smithi040.stdout:autoconf 2024-09-21T01:51:05.215 INFO:teuthology.orchestra.run.smithi040.stdout:./configure \ 2024-09-21T01:51:05.215 INFO:teuthology.orchestra.run.smithi040.stdout: --libexecdir=/usr/lib \ 2024-09-21T01:51:05.216 INFO:teuthology.orchestra.run.smithi040.stdout: --exec_prefix=/var/lib 2024-09-21T01:51:05.576 INFO:teuthology.orchestra.run.smithi040.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-21T01:51:05.576 INFO:teuthology.orchestra.run.smithi040.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-21T01:51:05.577 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to print strings... printf 2024-09-21T01:51:05.577 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... gcc 2024-09-21T01:51:05.672 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the C compiler works... yes 2024-09-21T01:51:05.673 INFO:teuthology.orchestra.run.smithi040.stdout:checking for C compiler default output file name... a.out 2024-09-21T01:51:05.701 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of executables... 2024-09-21T01:51:05.783 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are cross compiling... no 2024-09-21T01:51:05.801 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of object files... o 2024-09-21T01:51:05.819 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... yes 2024-09-21T01:51:05.835 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... yes 2024-09-21T01:51:05.895 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-21T01:51:05.898 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a sed that does not truncate output... /bin/sed 2024-09-21T01:51:05.900 INFO:teuthology.orchestra.run.smithi040.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-09-21T01:51:05.901 INFO:teuthology.orchestra.run.smithi040.stdout:checking for egrep... /bin/grep -E 2024-09-21T01:51:05.902 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fgrep... /bin/grep -F 2024-09-21T01:51:05.906 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ld used by gcc... /bin/ld 2024-09-21T01:51:05.907 INFO:teuthology.orchestra.run.smithi040.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-09-21T01:51:05.921 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-09-21T01:51:06.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:51:06.378 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:51:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-09-21T01:51:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2024-09-21T01:51:06.908 INFO:teuthology.orchestra.run.smithi040.stdout:checking the maximum length of command line arguments... 1572864 2024-09-21T01:51:06.912 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-21T01:51:06.912 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-21T01:51:06.912 INFO:teuthology.orchestra.run.smithi040.stdout:checking for /bin/ld option to reload object files... -r 2024-09-21T01:51:06.912 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdump... objdump 2024-09-21T01:51:06.912 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to recognize dependent libraries... pass_all 2024-09-21T01:51:06.912 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlltool... no 2024-09-21T01:51:06.912 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-21T01:51:06.913 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ar... ar 2024-09-21T01:51:06.963 INFO:teuthology.orchestra.run.smithi040.stdout:checking for archiver @FILE support... @ 2024-09-21T01:51:06.963 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strip... strip 2024-09-21T01:51:06.963 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ranlib... ranlib 2024-09-21T01:51:06.963 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gawk... gawk 2024-09-21T01:51:07.030 INFO:teuthology.orchestra.run.smithi040.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-09-21T01:51:07.032 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sysroot... no 2024-09-21T01:51:07.035 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a working dd... /bin/dd 2024-09-21T01:51:07.037 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-09-21T01:51:07.051 INFO:teuthology.orchestra.run.smithi040.stdout:checking for mt... no 2024-09-21T01:51:07.053 INFO:teuthology.orchestra.run.smithi040.stdout:checking if : is a manifest tool... no 2024-09-21T01:51:07.119 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to run the C preprocessor... gcc -E 2024-09-21T01:51:07.316 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ANSI C header files... yes 2024-09-21T01:51:07.337 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... yes 2024-09-21T01:51:07.369 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... yes 2024-09-21T01:51:07.394 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdlib.h... yes 2024-09-21T01:51:07.419 INFO:teuthology.orchestra.run.smithi040.stdout:checking for string.h... yes 2024-09-21T01:51:07.445 INFO:teuthology.orchestra.run.smithi040.stdout:checking for memory.h... yes 2024-09-21T01:51:07.471 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... yes 2024-09-21T01:51:07.498 INFO:teuthology.orchestra.run.smithi040.stdout:checking for inttypes.h... yes 2024-09-21T01:51:07.524 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdint.h... yes 2024-09-21T01:51:07.562 INFO:teuthology.orchestra.run.smithi040.stdout:checking for unistd.h... yes 2024-09-21T01:51:07.596 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlfcn.h... yes 2024-09-21T01:51:07.599 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdir... .libs 2024-09-21T01:51:07.664 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-21T01:51:07.664 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-21T01:51:07.679 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-21T01:51:07.710 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc static flag -static works... no 2024-09-21T01:51:07.731 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... yes 2024-09-21T01:51:07.731 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-21T01:51:07.737 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-21T01:51:07.771 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether -lc should be explicitly linked in... no 2024-09-21T01:51:07.819 INFO:teuthology.orchestra.run.smithi040.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-21T01:51:07.819 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to hardcode library paths into programs... immediate 2024-09-21T01:51:07.820 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether stripping libraries is possible... yes 2024-09-21T01:51:07.820 INFO:teuthology.orchestra.run.smithi040.stdout:checking if libtool supports shared libraries... yes 2024-09-21T01:51:07.820 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build shared libraries... yes 2024-09-21T01:51:07.820 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build static libraries... yes 2024-09-21T01:51:07.826 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... (cached) gcc 2024-09-21T01:51:07.843 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-21T01:51:07.843 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-21T01:51:07.843 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-21T01:51:07.843 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gmake... /usr/bin/gmake 2024-09-21T01:51:07.843 INFO:teuthology.orchestra.run.smithi040.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-21T01:51:07.844 INFO:teuthology.orchestra.run.smithi040.stdout:checking for tar... /bin/tar 2024-09-21T01:51:07.844 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gzip... /bin/gzip 2024-09-21T01:51:07.863 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc -MM is supported... yes 2024-09-21T01:51:07.863 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sort... /bin/sort 2024-09-21T01:51:07.863 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2024-09-21T01:51:07.863 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpm... /bin/rpm 2024-09-21T01:51:07.866 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpmbuild... no 2024-09-21T01:51:07.892 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h usability... yes 2024-09-21T01:51:07.901 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h presence... yes 2024-09-21T01:51:07.901 INFO:teuthology.orchestra.run.smithi040.stdout:checking for assert.h... yes 2024-09-21T01:51:07.928 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h usability... no 2024-09-21T01:51:07.940 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h presence... no 2024-09-21T01:51:07.940 INFO:teuthology.orchestra.run.smithi040.stdout:checking for bstring.h... no 2024-09-21T01:51:07.965 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h usability... yes 2024-09-21T01:51:07.974 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h presence... yes 2024-09-21T01:51:07.974 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libgen.h... yes 2024-09-21T01:51:08.004 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h usability... yes 2024-09-21T01:51:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h presence... yes 2024-09-21T01:51:08.013 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dirent.h... yes 2024-09-21T01:51:08.075 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h usability... yes 2024-09-21T01:51:08.084 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h presence... yes 2024-09-21T01:51:08.084 INFO:teuthology.orchestra.run.smithi040.stdout:checking for errno.h... yes 2024-09-21T01:51:08.113 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h usability... yes 2024-09-21T01:51:08.123 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h presence... yes 2024-09-21T01:51:08.123 INFO:teuthology.orchestra.run.smithi040.stdout:checking for malloc.h... yes 2024-09-21T01:51:08.151 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h usability... no 2024-09-21T01:51:08.163 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h presence... no 2024-09-21T01:51:08.163 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid.h... no 2024-09-21T01:51:08.218 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h usability... yes 2024-09-21T01:51:08.228 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h presence... yes 2024-09-21T01:51:08.229 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid/uuid.h... yes 2024-09-21T01:51:08.256 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h usability... no 2024-09-21T01:51:08.267 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h presence... no 2024-09-21T01:51:08.268 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/uuid.h... no 2024-09-21T01:51:08.314 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h usability... yes 2024-09-21T01:51:08.323 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h presence... yes 2024-09-21T01:51:08.323 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/file.h... yes 2024-09-21T01:51:08.354 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h usability... yes 2024-09-21T01:51:08.363 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h presence... yes 2024-09-21T01:51:08.364 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fcntl.h... yes 2024-09-21T01:51:08.391 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h usability... no 2024-09-21T01:51:08.402 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h presence... no 2024-09-21T01:51:08.402 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/syssgi.h... no 2024-09-21T01:51:08.477 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h usability... yes 2024-09-21T01:51:08.489 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h presence... yes 2024-09-21T01:51:08.489 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/param.h... yes 2024-09-21T01:51:08.494 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... (cached) yes 2024-09-21T01:51:08.527 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h usability... yes 2024-09-21T01:51:08.536 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h presence... yes 2024-09-21T01:51:08.536 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/statvfs.h... yes 2024-09-21T01:51:08.564 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h usability... yes 2024-09-21T01:51:08.574 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h presence... yes 2024-09-21T01:51:08.574 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/time.h... yes 2024-09-21T01:51:08.613 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h usability... yes 2024-09-21T01:51:08.622 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h presence... yes 2024-09-21T01:51:08.622 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/ioctl.h... yes 2024-09-21T01:51:08.664 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h usability... yes 2024-09-21T01:51:08.674 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h presence... yes 2024-09-21T01:51:08.674 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/wait.h... yes 2024-09-21T01:51:08.679 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... (cached) yes 2024-09-21T01:51:08.683 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... (cached) yes 2024-09-21T01:51:08.714 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h usability... yes 2024-09-21T01:51:08.721 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h presence... yes 2024-09-21T01:51:08.721 INFO:teuthology.orchestra.run.smithi040.stdout:checking for err.h... yes 2024-09-21T01:51:08.749 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h usability... yes 2024-09-21T01:51:08.757 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h presence... yes 2024-09-21T01:51:08.757 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/falloc.h... yes 2024-09-21T01:51:08.786 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-21T01:51:08.797 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-21T01:51:08.797 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-21T01:51:08.822 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-21T01:51:08.832 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-21T01:51:08.833 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-21T01:51:08.857 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h usability... no 2024-09-21T01:51:08.869 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h presence... no 2024-09-21T01:51:08.869 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/platform_defs.h... no 2024-09-21T01:51:08.894 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h usability... no 2024-09-21T01:51:08.905 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h presence... no 2024-09-21T01:51:08.905 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfs/ioctl.h... no 2024-09-21T01:51:08.931 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h usability... no 2024-09-21T01:51:08.942 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h presence... no 2024-09-21T01:51:08.942 INFO:teuthology.orchestra.run.smithi040.stdout:checking for cifs/ioctl.h... no 2024-09-21T01:51:08.977 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h usability... yes 2024-09-21T01:51:08.987 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h presence... yes 2024-09-21T01:51:08.987 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/mman.h... yes 2024-09-21T01:51:09.014 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/ext4.h usability... no 2024-09-21T01:51:09.026 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/ext4.h presence... no 2024-09-21T01:51:09.026 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/ext4.h... no 2024-09-21T01:51:09.038 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs_log_format.h... no 2024-09-21T01:51:09.086 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare... no 2024-09-21T01:51:09.117 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare in -luuid... yes 2024-09-21T01:51:09.174 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs.h... yes 2024-09-21T01:51:09.187 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/libxfs.h... no 2024-09-21T01:51:09.203 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-21T01:51:09.234 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xqm.h... yes 2024-09-21T01:51:09.284 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-21T01:51:09.308 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h usability... yes 2024-09-21T01:51:09.316 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h presence... yes 2024-09-21T01:51:09.316 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/handle.h... yes 2024-09-21T01:51:09.357 INFO:teuthology.orchestra.run.smithi040.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-21T01:51:09.395 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h usability... yes 2024-09-21T01:51:09.405 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h presence... yes 2024-09-21T01:51:09.406 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/acl.h... yes 2024-09-21T01:51:09.433 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h usability... yes 2024-09-21T01:51:09.443 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h presence... yes 2024-09-21T01:51:09.443 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl/libacl.h... yes 2024-09-21T01:51:09.476 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl_init in -lacl... yes 2024-09-21T01:51:09.499 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h usability... no 2024-09-21T01:51:09.511 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h presence... no 2024-09-21T01:51:09.511 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm-ndbm.h... no 2024-09-21T01:51:09.535 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h usability... yes 2024-09-21T01:51:09.546 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h presence... yes 2024-09-21T01:51:09.546 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm/ndbm.h... yes 2024-09-21T01:51:09.582 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_open in -lgdbm... no 2024-09-21T01:51:09.618 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_fetch in -lgdbm... no 2024-09-21T01:51:09.654 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_store in -lgdbm... no 2024-09-21T01:51:09.689 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_close in -lgdbm... no 2024-09-21T01:51:09.735 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-09-21T01:51:09.768 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-09-21T01:51:09.801 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-09-21T01:51:09.835 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-09-21T01:51:09.860 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h usability... yes 2024-09-21T01:51:09.871 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h presence... yes 2024-09-21T01:51:09.871 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libaio.h... yes 2024-09-21T01:51:09.895 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h usability... no 2024-09-21T01:51:09.907 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h presence... no 2024-09-21T01:51:09.907 INFO:teuthology.orchestra.run.smithi040.stdout:checking for liburing.h... no 2024-09-21T01:51:09.932 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h usability... yes 2024-09-21T01:51:09.943 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h presence... yes 2024-09-21T01:51:09.943 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/capability.h... yes 2024-09-21T01:51:09.969 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h usability... yes 2024-09-21T01:51:09.977 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h presence... yes 2024-09-21T01:51:09.977 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fiemap.h... yes 2024-09-21T01:51:10.012 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fallocate... yes 2024-09-21T01:51:10.048 INFO:teuthology.orchestra.run.smithi040.stdout:checking for open_by_handle_at... yes 2024-09-21T01:51:10.073 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h usability... yes 2024-09-21T01:51:10.082 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h presence... yes 2024-09-21T01:51:10.082 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fs.h... yes 2024-09-21T01:51:10.105 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h usability... no 2024-09-21T01:51:10.116 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h presence... no 2024-09-21T01:51:10.117 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfsutil.h... no 2024-09-21T01:51:10.155 INFO:teuthology.orchestra.run.smithi040.stdout:checking for copy_file_range... yes 2024-09-21T01:51:10.192 INFO:teuthology.orchestra.run.smithi040.stdout:checking for SEEK_DATA... yes 2024-09-21T01:51:10.243 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BMV_OF_SHARED... yes 2024-09-21T01:51:10.281 INFO:teuthology.orchestra.run.smithi040.stdout:checking for nftw... yes 2024-09-21T01:51:10.325 INFO:teuthology.orchestra.run.smithi040.stdout:checking for RLIMIT_NOFILE... yes 2024-09-21T01:51:10.359 INFO:teuthology.orchestra.run.smithi040.stdout:checking for new enough XFS_IOC_EXCHANGE_RANGE... no 2024-09-21T01:51:10.395 INFO:teuthology.orchestra.run.smithi040.stdout:checking for FICLONE... yes 2024-09-21T01:51:10.429 INFO:teuthology.orchestra.run.smithi040.stdout:checking for renameat2... yes 2024-09-21T01:51:10.465 INFO:teuthology.orchestra.run.smithi040.stdout:checking for reallocarray... yes 2024-09-21T01:51:10.497 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct mount_attr... yes 2024-09-21T01:51:10.539 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-21T01:51:10.573 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-21T01:51:10.607 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-21T01:51:10.641 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-21T01:51:10.675 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-21T01:51:10.709 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-21T01:51:10.744 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-21T01:51:10.771 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h usability... yes 2024-09-21T01:51:10.780 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h presence... yes 2024-09-21T01:51:10.780 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs.h... yes 2024-09-21T01:51:10.815 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-21T01:51:10.825 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-21T01:51:10.825 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs_tree.h... yes 2024-09-21T01:51:10.848 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-21T01:51:10.872 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-21T01:51:10.888 INFO:teuthology.orchestra.run.smithi040.stdout:configure: creating ./config.status 2024-09-21T01:51:11.193 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/builddefs 2024-09-21T01:51:11.204 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/config.h 2024-09-21T01:51:11.212 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: executing libtool commands 2024-09-21T01:51:11.252 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2024-09-21T01:51:11.255 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2024-09-21T01:51:11.259 INFO:teuthology.orchestra.run.smithi040.stdout: [LTDEP] 2024-09-21T01:51:11.406 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dataascii.lo 2024-09-21T01:51:11.519 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] databin.lo 2024-09-21T01:51:11.659 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] datapid.lo 2024-09-21T01:51:11.763 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] file_lock.lo 2024-09-21T01:51:11.901 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] forker.lo 2024-09-21T01:51:12.029 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pattern.lo 2024-09-21T01:51:12.143 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_flags.lo 2024-09-21T01:51:12.277 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random_range.lo 2024-09-21T01:51:12.495 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] string_to_tokens.lo 2024-09-21T01:51:12.592 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] str_to_bytes.lo 2024-09-21T01:51:12.727 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] tlibio.lo 2024-09-21T01:51:12.951 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] write_log.lo 2024-09-21T01:51:13.177 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random.lo 2024-09-21T01:51:13.277 INFO:teuthology.orchestra.run.smithi040.stdout: [LD] 2024-09-21T01:51:13.359 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2024-09-21T01:51:13.362 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-21T01:51:13.509 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] doio 2024-09-21T01:51:14.145 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsstress 2024-09-21T01:51:15.529 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsx 2024-09-21T01:51:16.223 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] growfiles 2024-09-21T01:51:16.702 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] iogen 2024-09-21T01:51:17.050 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-stress 2024-09-21T01:51:17.445 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2024-09-21T01:51:17.451 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-21T01:51:19.259 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-21T01:51:19.290 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-21T01:51:19.298 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-21T01:51:19.517 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2024-09-21T01:51:19.540 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirstress 2024-09-21T01:51:19.755 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill 2024-09-21T01:51:19.892 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill2 2024-09-21T01:51:20.101 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getpagesize 2024-09-21T01:51:20.220 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holes 2024-09-21T01:51:20.394 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] lstat64 2024-09-21T01:51:20.558 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nametest 2024-09-21T01:51:20.777 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] permname 2024-09-21T01:51:20.959 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] randholes 2024-09-21T01:51:21.185 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] runas 2024-09-21T01:51:21.341 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] truncfile 2024-09-21T01:51:21.501 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] usemem 2024-09-21T01:51:21.634 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmapcat 2024-09-21T01:51:21.764 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_reader 2024-09-21T01:51:21.897 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_writer 2024-09-21T01:51:22.029 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirperf 2024-09-21T01:51:22.236 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] metaperf 2024-09-21T01:51:22.497 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] devzero 2024-09-21T01:51:22.653 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] feature 2024-09-21T01:51:22.849 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] alloc 2024-09-21T01:51:23.041 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fault 2024-09-21T01:51:23.183 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fstest 2024-09-21T01:51:23.401 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_access_root 2024-09-21T01:51:23.537 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] godown 2024-09-21T01:51:23.687 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] resvtest 2024-09-21T01:51:23.855 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writemod 2024-09-21T01:51:23.984 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writev_on_pagefault 2024-09-21T01:51:24.124 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] makeextents 2024-09-21T01:51:24.282 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] itrash 2024-09-21T01:51:24.416 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] rename 2024-09-21T01:51:24.540 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] multi_open_unlink 2024-09-21T01:51:24.687 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_sync 2024-09-21T01:51:24.847 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] genhashnames 2024-09-21T01:51:25.020 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_holes 2024-09-21T01:51:25.150 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev 2024-09-21T01:51:25.281 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_cmtime 2024-09-21T01:51:25.421 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirhash_collide 2024-09-21T01:51:25.596 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_rename_overwrite 2024-09-21T01:51:25.721 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holetest 2024-09-21T01:51:25.928 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_self 2024-09-21T01:51:26.053 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] af_unix 2024-09-21T01:51:26.186 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_stale_pmd 2024-09-21T01:51:26.320 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_race 2024-09-21T01:51:26.467 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_fallocate 2024-09-21T01:51:26.600 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-err 2024-09-21T01:51:26.765 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_write_ro 2024-09-21T01:51:26.901 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-21T01:51:27.043 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-21T01:51:27.180 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ofd_locks 2024-09-21T01:51:27.355 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_collision 2024-09-21T01:51:27.541 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-write-concurrent 2024-09-21T01:51:27.693 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_get_file_time 2024-09-21T01:51:27.822 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_short_dirs 2024-09-21T01:51:27.973 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_long_dirs 2024-09-21T01:51:28.122 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_enospc 2024-09-21T01:51:28.290 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev_overlap 2024-09-21T01:51:28.440 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] checkpoint_journal 2024-09-21T01:51:28.577 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-rw-fault 2024-09-21T01:51:28.742 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] allocstale 2024-09-21T01:51:28.892 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_memory_failure 2024-09-21T01:51:29.045 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fake-dump-rootino 2024-09-21T01:51:29.178 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-buf-fault 2024-09-21T01:51:29.314 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] rewinddir-test 2024-09-21T01:51:29.466 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] readdir-while-renames 2024-09-21T01:51:29.611 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-append-buf-fault 2024-09-21T01:51:29.754 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsctl 2024-09-21T01:51:29.923 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bstat 2024-09-21T01:51:30.109 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mtab 2024-09-21T01:51:30.276 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getdevicesize 2024-09-21T01:51:30.402 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_reader 2024-09-21T01:51:30.543 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_writer 2024-09-21T01:51:30.681 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ftrunc 2024-09-21T01:51:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] trunc 2024-09-21T01:51:30.956 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fs_perms 2024-09-21T01:51:31.101 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] testx 2024-09-21T01:51:31.218 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] looptest 2024-09-21T01:51:31.391 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] locktest 2024-09-21T01:51:31.678 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_mmap 2024-09-21T01:51:31.823 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test 2024-09-21T01:51:32.004 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] deduperace 2024-09-21T01:51:32.180 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test_modified 2024-09-21T01:51:32.357 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset 2024-09-21T01:51:32.489 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_futimens 2024-09-21T01:51:32.613 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_immutable 2024-09-21T01:51:33.197 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stale_handle 2024-09-21T01:51:33.348 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pwrite_mmap_blocked 2024-09-21T01:51:33.483 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset2 2024-09-21T01:51:33.656 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_sanity_test 2024-09-21T01:51:34.081 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_copy_test 2024-09-21T01:51:34.241 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_1 2024-09-21T01:51:34.371 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_2 2024-09-21T01:51:34.505 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-tester 2024-09-21T01:51:34.734 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nsexec 2024-09-21T01:51:34.892 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] cloner 2024-09-21T01:51:35.053 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] renameat2 2024-09-21T01:51:35.201 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_getcwd 2024-09-21T01:51:35.342 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] e4compact 2024-09-21T01:51:35.525 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] test-nextquota 2024-09-21T01:51:35.681 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] punch-alternating 2024-09-21T01:51:35.833 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-21T01:51:35.982 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] listxattr 2024-09-21T01:51:36.114 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-interleaved 2024-09-21T01:51:36.256 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_type 2024-09-21T01:51:36.396 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-invalidate-cache 2024-09-21T01:51:36.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:51:36.516 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:51:36.579 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stat_test 2024-09-21T01:51:36.850 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_encrypted_d_revalidate 2024-09-21T01:51:36.999 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr_replace_test 2024-09-21T01:51:37.144 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] swapon 2024-09-21T01:51:37.291 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mkswap 2024-09-21T01:51:37.428 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_attr_corruption 2024-09-21T01:51:37.560 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_open_tmpfiles 2024-09-21T01:51:37.721 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fscrypt-crypt-util 2024-09-21T01:51:38.372 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_null_ocount 2024-09-21T01:51:38.515 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice-test 2024-09-21T01:51:38.678 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] chprojid_fail 2024-09-21T01:51:38.822 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] detached_mounts_propagation 2024-09-21T01:51:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ext4_resize 2024-09-21T01:51:39.120 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_3 2024-09-21T01:51:39.296 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice2pipe 2024-09-21T01:51:39.441 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] uuid_ioctl 2024-09-21T01:51:39.579 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-21T01:51:39.725 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fiemap-fault 2024-09-21T01:51:39.864 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] min_dio_alignment 2024-09-21T01:51:40.000 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fiemap-tester 2024-09-21T01:51:40.242 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_stripealign 2024-09-21T01:51:40.379 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_by_handle 2024-09-21T01:51:40.607 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dbtest 2024-09-21T01:51:40.835 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_dio 2024-09-21T01:51:40.977 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsfind 2024-09-21T01:51:41.153 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_reflink_read_race 2024-09-21T01:51:41.325 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fssum 2024-09-21T01:51:41.742 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2024-09-21T01:51:41.747 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] replay-log 2024-09-21T01:51:42.044 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-21T01:51:42.048 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2024-09-21T01:51:42.054 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiocp 2024-09-21T01:51:42.260 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-21T01:51:42.410 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-read-race 2024-09-21T01:51:42.566 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cow-race 2024-09-21T01:51:42.702 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cycle-write 2024-09-21T01:51:42.866 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-eof-race 2024-09-21T01:51:43.030 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-extend-stat 2024-09-21T01:51:43.175 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-fcntl-race 2024-09-21T01:51:43.320 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-hole-filling-race 2024-09-21T01:51:43.450 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-failure 2024-09-21T01:51:43.591 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-readahead 2024-09-21T01:51:43.739 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiodio_sparse2 2024-09-21T01:51:43.937 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-subblock-eof-read 2024-09-21T01:51:44.061 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-write-verify 2024-09-21T01:51:44.237 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-21T01:51:44.354 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-21T01:51:44.469 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-last-ref-held-by-io 2024-09-21T01:51:44.624 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2024-09-21T01:51:44.629 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] vfstest 2024-09-21T01:51:48.109 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mount-idmapped 2024-09-21T01:51:48.465 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2024-09-21T01:51:48.469 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2024-09-21T01:51:48.472 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2024-09-21T01:51:48.478 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2024-09-21T01:51:48.485 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/btrfs/group.list 2024-09-21T01:51:48.550 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2024-09-21T01:51:48.555 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ceph/group.list 2024-09-21T01:51:48.570 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2024-09-21T01:51:48.576 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/cifs/group.list 2024-09-21T01:51:48.589 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2024-09-21T01:51:48.594 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ext4/group.list 2024-09-21T01:51:48.635 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2024-09-21T01:51:48.640 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/f2fs/group.list 2024-09-21T01:51:48.659 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2024-09-21T01:51:48.666 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/generic/group.list 2024-09-21T01:51:48.770 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2024-09-21T01:51:48.775 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/nfs/group.list 2024-09-21T01:51:48.791 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2024-09-21T01:51:48.796 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ocfs2/group.list 2024-09-21T01:51:48.811 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2024-09-21T01:51:48.816 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/overlay/group.list 2024-09-21T01:51:48.862 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-21T01:51:48.864 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/perf/group.list 2024-09-21T01:51:48.876 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2024-09-21T01:51:48.881 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/selftest/group.list 2024-09-21T01:51:48.895 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2024-09-21T01:51:48.900 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/tmpfs/group.list 2024-09-21T01:51:48.914 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2024-09-21T01:51:48.919 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/udf/group.list 2024-09-21T01:51:48.932 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2024-09-21T01:51:48.938 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/xfs/group.list 2024-09-21T01:51:49.045 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo make install) 2024-09-21T01:51:49.123 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2024-09-21T01:51:49.127 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2024-09-21T01:51:49.131 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2024-09-21T01:51:49.135 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2024-09-21T01:51:49.170 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2024-09-21T01:51:49.174 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-21T01:51:49.177 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2024-09-21T01:51:49.182 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2024-09-21T01:51:49.186 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2024-09-21T01:51:49.189 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2024-09-21T01:51:49.193 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2024-09-21T01:51:49.199 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2024-09-21T01:51:49.204 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/btrfs/group.list 2024-09-21T01:51:49.270 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2024-09-21T01:51:49.275 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ceph/group.list 2024-09-21T01:51:49.290 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2024-09-21T01:51:49.295 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/cifs/group.list 2024-09-21T01:51:49.309 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2024-09-21T01:51:49.314 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ext4/group.list 2024-09-21T01:51:49.355 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2024-09-21T01:51:49.360 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/f2fs/group.list 2024-09-21T01:51:49.379 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2024-09-21T01:51:49.385 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/generic/group.list 2024-09-21T01:51:49.488 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2024-09-21T01:51:49.493 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/nfs/group.list 2024-09-21T01:51:49.508 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2024-09-21T01:51:49.514 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ocfs2/group.list 2024-09-21T01:51:49.528 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2024-09-21T01:51:49.533 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/overlay/group.list 2024-09-21T01:51:49.577 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-21T01:51:49.582 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/perf/group.list 2024-09-21T01:51:49.594 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2024-09-21T01:51:49.599 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/selftest/group.list 2024-09-21T01:51:49.612 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2024-09-21T01:51:49.618 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/tmpfs/group.list 2024-09-21T01:51:49.632 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2024-09-21T01:51:49.637 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/udf/group.list 2024-09-21T01:51:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2024-09-21T01:51:49.656 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/xfs/group.list 2024-09-21T01:51:49.759 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-09-21T01:51:49.761 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-21T01:51:49.761 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-09-21T01:51:49.763 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-21T01:51:49.763 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-09-21T01:51:49.766 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-09-21T01:51:49.775 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-09-21T01:51:49.847 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-09-21T01:51:49.856 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-09-21T01:51:49.873 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2024-09-21T01:51:49.877 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2024-09-21T01:51:49.880 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2024-09-21T01:51:49.885 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2024-09-21T01:51:49.888 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C log-writes install 2024-09-21T01:51:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-09-21T01:51:49.898 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-09-21T01:51:49.908 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C perf install 2024-09-21T01:51:49.909 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-09-21T01:51:49.919 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-09-21T01:51:49.941 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-09-21T01:51:49.944 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-09-21T01:51:49.953 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-09-21T01:51:50.005 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C vfs install 2024-09-21T01:51:50.006 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-09-21T01:51:50.015 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-09-21T01:51:50.028 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-09-21T01:51:50.037 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames dio-append-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault min_dio_alignment fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-09-21T01:51:51.282 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-09-21T01:51:51.381 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-09-21T01:51:51.406 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-09-21T01:51:51.408 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2024-09-21T01:51:51.408 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-09-21T01:51:51.409 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-09-21T01:51:51.418 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-09-21T01:51:51.564 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-09-21T01:51:51.575 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/btrfs/ install 2024-09-21T01:51:51.578 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/btrfs/group.list 2024-09-21T01:51:51.629 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-09-21T01:51:51.637 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 330 331 332 /var/lib/xfstests/tests/btrfs 2024-09-21T01:51:52.506 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-09-21T01:51:52.514 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 330.out 331.out 332.out /var/lib/xfstests/tests/btrfs 2024-09-21T01:51:53.384 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ceph/ install 2024-09-21T01:51:53.386 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ceph/group.list 2024-09-21T01:51:53.401 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-09-21T01:51:53.410 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-09-21T01:51:53.429 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-09-21T01:51:53.438 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-09-21T01:51:53.458 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/cifs/ install 2024-09-21T01:51:53.461 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/cifs/group.list 2024-09-21T01:51:53.473 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-09-21T01:51:53.482 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-09-21T01:51:53.493 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-09-21T01:51:53.500 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-09-21T01:51:53.509 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ext4/ install 2024-09-21T01:51:53.512 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ext4/group.list 2024-09-21T01:51:53.552 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-09-21T01:51:53.561 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-09-21T01:51:53.747 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-09-21T01:51:53.756 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-09-21T01:51:53.951 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/f2fs/ install 2024-09-21T01:51:53.954 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/f2fs/group.list 2024-09-21T01:51:53.972 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-09-21T01:51:53.982 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 /var/lib/xfstests/tests/f2fs 2024-09-21T01:51:53.999 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-09-21T01:51:54.008 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out /var/lib/xfstests/tests/f2fs 2024-09-21T01:51:54.025 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/generic/ install 2024-09-21T01:51:54.028 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/generic/group.list 2024-09-21T01:51:54.133 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-09-21T01:51:54.142 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 /var/lib/xfstests/tests/generic 2024-09-21T01:51:56.149 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-09-21T01:51:56.158 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out /var/lib/xfstests/tests/generic 2024-09-21T01:51:58.197 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/nfs/ install 2024-09-21T01:51:58.199 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/nfs/group.list 2024-09-21T01:51:58.214 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-09-21T01:51:58.223 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-09-21T01:51:58.232 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-09-21T01:51:58.241 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-09-21T01:51:58.250 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ocfs2/ install 2024-09-21T01:51:58.253 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/ocfs2/group.list 2024-09-21T01:51:58.266 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-09-21T01:51:58.275 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-09-21T01:51:58.284 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-09-21T01:51:58.293 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-09-21T01:51:58.302 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/overlay/ install 2024-09-21T01:51:58.305 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/overlay/group.list 2024-09-21T01:51:58.347 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-09-21T01:51:58.356 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-09-21T01:51:58.641 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-09-21T01:51:58.650 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-09-21T01:51:58.935 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/perf/ install 2024-09-21T01:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/perf/group.list 2024-09-21T01:51:58.950 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-09-21T01:51:58.959 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-09-21T01:51:58.968 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-09-21T01:51:58.977 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-09-21T01:51:58.986 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/selftest/ install 2024-09-21T01:51:58.989 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/selftest/group.list 2024-09-21T01:51:59.001 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-09-21T01:51:59.010 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-09-21T01:51:59.032 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-09-21T01:51:59.041 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-09-21T01:51:59.063 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/tmpfs/ install 2024-09-21T01:51:59.066 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/tmpfs/group.list 2024-09-21T01:51:59.079 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-09-21T01:51:59.088 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-09-21T01:51:59.097 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-09-21T01:51:59.106 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-09-21T01:51:59.115 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/udf/ install 2024-09-21T01:51:59.117 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/udf/group.list 2024-09-21T01:51:59.129 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-09-21T01:51:59.138 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-09-21T01:51:59.147 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-09-21T01:51:59.156 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-09-21T01:51:59.165 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/xfs/ install 2024-09-21T01:51:59.168 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.9vjfAyR2gpxfstests-dev/tests/xfs/group.list 2024-09-21T01:51:59.274 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-09-21T01:51:59.283 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 /var/lib/xfstests/tests/xfs 2024-09-21T01:52:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-09-21T01:52:01.226 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 021.out.default 021.out.parent 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 614.out.lba1024 614.out.lba2048 614.out.lba4096 614.out.lba512 021.cfg 033.cfg 216.cfg 614.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 612.out 613.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out 801.out /var/lib/xfstests/tests/xfs 2024-09-21T01:52:03.197 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-09-21T01:52:03.206 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-09-21T01:52:03.215 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-09-21T01:52:03.224 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-09-21T01:52:03.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:52:03.235 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec ls tests/generic) 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:001 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:001.out 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:002 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:002.out 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:003 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:003.out 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:004 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:004.out 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:005 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:005.out 2024-09-21T01:52:03.293 INFO:teuthology.orchestra.run.smithi040.stdout:006 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:006.out 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:007 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:007.out 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:008 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:008.out 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:009 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:009.out 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:010 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:010.out 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:011 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:011.out 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:012 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:012.out 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:013 2024-09-21T01:52:03.294 INFO:teuthology.orchestra.run.smithi040.stdout:013.out 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:014 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:014.out 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:015 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:015.out 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:016 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:016.out 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:017 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:017.out 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:018 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:018.out 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:019 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:019.out 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:020 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:020.out 2024-09-21T01:52:03.295 INFO:teuthology.orchestra.run.smithi040.stdout:021 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:021.out 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:022 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:022.out 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:023 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:023.out 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:024 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:024.out 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:025 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:025.out 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:026 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:026.out 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:027 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:027.out 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:028 2024-09-21T01:52:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:028.out 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:029 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:029.out 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:030 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:030.out 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:031 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:031.out 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:032 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:032.out 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:033 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:033.out 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:034 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:034.out 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:035 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:035.cfg 2024-09-21T01:52:03.297 INFO:teuthology.orchestra.run.smithi040.stdout:035.out.default 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:035.out.nfs 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:036 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:036.out 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:037 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:037.out 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:038 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:038.out 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:039 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:039.out 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:040 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:040.out 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:041 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:041.out 2024-09-21T01:52:03.298 INFO:teuthology.orchestra.run.smithi040.stdout:042 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:042.out 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:043 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:043.out 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:044 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:044.out 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:045 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:045.out 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:046 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:046.out 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:047 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:047.out 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:048 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:048.out 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:049 2024-09-21T01:52:03.299 INFO:teuthology.orchestra.run.smithi040.stdout:049.out 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:050 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:050.cfg 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.default 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.nojournal 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.xfsquota 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:051 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:051.out 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:052 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:052.out 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:053 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:053.out 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:054 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:054.out 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:055 2024-09-21T01:52:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:055.out 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:056 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:056.out 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:057 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:057.out 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:058 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:058.out 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:059 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:059.out 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:060 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:060.out 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:061 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:061.out 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:062 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:062.out 2024-09-21T01:52:03.301 INFO:teuthology.orchestra.run.smithi040.stdout:063 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:063.out 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:064 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:064.out 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:065 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:065.out 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:066 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:066.out 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:067 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:067.out 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:068 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:068.out 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:069 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:069.out 2024-09-21T01:52:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:070 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:070.out 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:071 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:071.out 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:072 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:072.out 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:073 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:073.out 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:074 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:074.out 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:075 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:075.out 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:076 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:076.out 2024-09-21T01:52:03.303 INFO:teuthology.orchestra.run.smithi040.stdout:077 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:077.out 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:078 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:078.out 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:079 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:079.out 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:080 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:080.out 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:081 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:081.out 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:082 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:082.out 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:083 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:083.out 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:084 2024-09-21T01:52:03.304 INFO:teuthology.orchestra.run.smithi040.stdout:084.out 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:085 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:085.out 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:086 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:086.out 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:087 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:087.out 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:088 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:088.out 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:089 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:089.out 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:090 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:090.out 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:091 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:091.out 2024-09-21T01:52:03.305 INFO:teuthology.orchestra.run.smithi040.stdout:092 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:092.out 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:093 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:093.out 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:094 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:094.out 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:095 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:095.out 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:096 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:096.out 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:097 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:097.out 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:098 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:098.out 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:099 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:099.out 2024-09-21T01:52:03.306 INFO:teuthology.orchestra.run.smithi040.stdout:100 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:100.out 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:101 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:101.out 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:102 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:102.out 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:103 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:103.out 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:104 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:104.out 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:105 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:105.out 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:106 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:106.out 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:107 2024-09-21T01:52:03.307 INFO:teuthology.orchestra.run.smithi040.stdout:107.out 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:108 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:108.out 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:109 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:109.out 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:110 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:110.out 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:111 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:111.out 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:112 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:112.out 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:113 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:113.out 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:114 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:114.out 2024-09-21T01:52:03.308 INFO:teuthology.orchestra.run.smithi040.stdout:115 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:115.out 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:116 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:116.out 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:117 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:117.out 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:118 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:118.out 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:119 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:119.out 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:120 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:120.out 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:121 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:121.out 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:122 2024-09-21T01:52:03.309 INFO:teuthology.orchestra.run.smithi040.stdout:122.out 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:123 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:123.out 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:124 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:124.out 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:125 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:125.out 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:126 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:126.out 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:127 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:127.out 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:128 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:128.out 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:129 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:129.out 2024-09-21T01:52:03.310 INFO:teuthology.orchestra.run.smithi040.stdout:130 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:130.out 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:131 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:131.out 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:132 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:132.out 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:133 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:133.out 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:134 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:134.out 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:135 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:135.out 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:136 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:136.out 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:137 2024-09-21T01:52:03.311 INFO:teuthology.orchestra.run.smithi040.stdout:137.out 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:138 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:138.out 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:139 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:139.out 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:140 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:140.out 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:141 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:141.out 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:142 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:142.out 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:143 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:143.out 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:144 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:144.out 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:145 2024-09-21T01:52:03.312 INFO:teuthology.orchestra.run.smithi040.stdout:145.out 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:146 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:146.out 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:147 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:147.out 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:148 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:148.out 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:149 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:149.out 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:150 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:150.out 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:151 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:151.out 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:152 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:152.out 2024-09-21T01:52:03.313 INFO:teuthology.orchestra.run.smithi040.stdout:153 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:153.out 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:154 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:154.out 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:155 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:155.out 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:156 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:156.out 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:157 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:157.out 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:158 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:158.out 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:159 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:159.out 2024-09-21T01:52:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:160 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:160.out 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:161 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:161.out 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:162 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:162.out 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:163 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:163.out 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:164 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:164.out 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:165 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:165.out 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:166 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:166.out 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:167 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:167.out 2024-09-21T01:52:03.315 INFO:teuthology.orchestra.run.smithi040.stdout:168 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:168.out 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:169 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:169.out 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:170 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:170.out 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:171 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:171.out 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:172 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:172.out 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:173 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:173.out 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:174 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:174.out 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:175 2024-09-21T01:52:03.316 INFO:teuthology.orchestra.run.smithi040.stdout:175.out 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:176 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:176.out 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:177 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:177.out 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:178 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:178.out 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:179 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:179.out 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:180 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:180.out 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:181 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:181.out 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:182 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:182.out 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:183 2024-09-21T01:52:03.317 INFO:teuthology.orchestra.run.smithi040.stdout:183.out 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:184 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:184.out 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:185 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:185.out 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:186 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:186.out 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:187 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:187.out 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:188 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:188.out 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:189 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:189.out 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:190 2024-09-21T01:52:03.318 INFO:teuthology.orchestra.run.smithi040.stdout:190.out 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:191 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:191.out 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:192 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:192.out 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:193 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:193.out 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:194 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:194.out 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:195 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:195.out 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:196 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:196.out 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:197 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:197.out 2024-09-21T01:52:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:198 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:198.out 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:199 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:199.out 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:200 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:200.out 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:201 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:201.out 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:202 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:202.out 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:203 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:203.out 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:204 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:204.out 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:205 2024-09-21T01:52:03.320 INFO:teuthology.orchestra.run.smithi040.stdout:205.out 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:206 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:206.out 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:207 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:207.out 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:208 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:208.out 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:209 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:209.out 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:210 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:210.out 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:211 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:211.out 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:212 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:212.out 2024-09-21T01:52:03.321 INFO:teuthology.orchestra.run.smithi040.stdout:213 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:213.out 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:214 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:214.out 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:215 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:215.out 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:216 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:216.out 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:217 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:217.out 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:218 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:218.out 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:219 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:219.out 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:220 2024-09-21T01:52:03.322 INFO:teuthology.orchestra.run.smithi040.stdout:220.out 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:221 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:221.out 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:222 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:222.out 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:223 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:223.out 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:224 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:224.out 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:225 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:225.out 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:226 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:226.out 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:227 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:227.out 2024-09-21T01:52:03.323 INFO:teuthology.orchestra.run.smithi040.stdout:228 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:228.out 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:229 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:229.out 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:230 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:230.out 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:231 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:231.out 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:232 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:232.out 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:233 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:233.out 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:234 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:234.out 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:235 2024-09-21T01:52:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:235.out 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:236 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:236.out 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:237 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:237.out 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:238 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:238.out 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:239 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:239.out 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:240 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:240.out 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:241 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:241.out 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:242 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:242.out 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:243 2024-09-21T01:52:03.325 INFO:teuthology.orchestra.run.smithi040.stdout:243.out 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:244 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:244.out 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:245 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:245.out 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:246 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:246.out 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:247 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:247.out 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:248 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:248.out 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:249 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:249.out 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:250 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:250.out 2024-09-21T01:52:03.326 INFO:teuthology.orchestra.run.smithi040.stdout:251 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:251.out 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:252 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:252.out 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:253 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:253.out 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:254 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:254.out 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:255 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:255.out 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:256 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:256.out 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:257 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:257.out 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:258 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:258.out 2024-09-21T01:52:03.327 INFO:teuthology.orchestra.run.smithi040.stdout:259 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:259.out 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:260 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:260.out 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:261 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:261.out 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:262 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:262.out 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:263 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:263.out 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:264 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:264.out 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:265 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:265.out 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:266 2024-09-21T01:52:03.328 INFO:teuthology.orchestra.run.smithi040.stdout:266.out 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:267 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:267.out 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:268 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:268.out 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:269 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:269.out 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:270 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:270.out 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:271 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:271.out 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:272 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:272.out 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:273 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:273.out 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:274 2024-09-21T01:52:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:274.out 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:275 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:275.out 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:276 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:276.out 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:277 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:277.out 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:278 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:278.out 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:279 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:279.out 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:280 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:280.out 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:281 2024-09-21T01:52:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:281.out 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:282 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:282.out 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:283 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:283.out 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:284 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:284.out 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:285 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:285.out 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:286 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:286.out 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:287 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:287.out 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:288 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:288.out 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:289 2024-09-21T01:52:03.331 INFO:teuthology.orchestra.run.smithi040.stdout:289.out 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:290 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:290.out 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:291 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:291.out 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:292 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:292.out 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:293 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:293.out 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:294 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:294.out 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:295 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:295.out 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:296 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:296.out 2024-09-21T01:52:03.332 INFO:teuthology.orchestra.run.smithi040.stdout:297 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:297.out 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:298 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:298.out 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:299 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:299.out 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:300 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:300.out 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:301 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:301.out 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:302 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:302.out 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:303 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:303.out 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:304 2024-09-21T01:52:03.333 INFO:teuthology.orchestra.run.smithi040.stdout:304.out 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:305 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:305.out 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:306 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:306.out 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:307 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:307.out 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:308 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:308.out 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:309 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:309.out 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:310 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:310.out 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:311 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:311.out 2024-09-21T01:52:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:312 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:312.out 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:313 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:313.out 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:314 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:314.out 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:315 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:315.out 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:316 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:316.out 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:317 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:317.out 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:318 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:318.out 2024-09-21T01:52:03.335 INFO:teuthology.orchestra.run.smithi040.stdout:319 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:319.out 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:320 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:320.out 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:321 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:321.out 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:322 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:322.out 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:323 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:323.out 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:324 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:324.out 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:325 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:325.out 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:326 2024-09-21T01:52:03.336 INFO:teuthology.orchestra.run.smithi040.stdout:326.out 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:327 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:327.out 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:328 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:328.out 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:329 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:329.out 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:330 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:330.out 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:331 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:331.out 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:332 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:332.out 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:333 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:333.out 2024-09-21T01:52:03.337 INFO:teuthology.orchestra.run.smithi040.stdout:334 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:334.out 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:335 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:335.out 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:336 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:336.out 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:337 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:337.out 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:338 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:338.out 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:339 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:339.out 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:340 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:340.out 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:341 2024-09-21T01:52:03.338 INFO:teuthology.orchestra.run.smithi040.stdout:341.out 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:342 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:342.out 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:343 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:343.out 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:344 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:344.out 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:345 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:345.out 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:346 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:346.out 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:347 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:347.out 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:348 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:348.out 2024-09-21T01:52:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:349 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:349.out 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:350 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:350.out 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:351 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:351.out 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:352 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:352.out 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:353 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:353.out 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:354 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:354.out 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:355 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:355.out 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:356 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:356.out 2024-09-21T01:52:03.340 INFO:teuthology.orchestra.run.smithi040.stdout:357 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:357.out 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:358 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:358.out 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:359 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:359.out 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:360 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:360.out 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:361 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:361.out 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:362 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:362.out 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:371 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:371.out 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:372 2024-09-21T01:52:03.341 INFO:teuthology.orchestra.run.smithi040.stdout:372.out 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:373 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:373.out 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:374 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:374.out 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:375 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:375.out 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:376 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:376.out 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:377 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:377.out 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:378 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:378.out 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:379 2024-09-21T01:52:03.342 INFO:teuthology.orchestra.run.smithi040.stdout:379.out 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:380 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:380.out 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:381 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:381.out 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:382 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:382.out 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:383 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:383.out 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:384 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:384.out 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:385 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:385.out 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:386 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:386.out 2024-09-21T01:52:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:387 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:387.out 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:388 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:388.out 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:389 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:389.out 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:390 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:390.out 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:391 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:391.out 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:392 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:392.out 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:393 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:393.out 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:394 2024-09-21T01:52:03.344 INFO:teuthology.orchestra.run.smithi040.stdout:394.out 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:395 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:395.out 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:396 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:396.out 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:397 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:397.out 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:398 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:398.out 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:399 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:399.out 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:400 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:400.out 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:401 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:401.out 2024-09-21T01:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:402 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:402.out 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:403 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:403.out 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:404 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:404.out 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:405 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:405.out 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:406 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:406.out 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:407 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:407.out 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:408 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:408.out 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:409 2024-09-21T01:52:03.346 INFO:teuthology.orchestra.run.smithi040.stdout:409.out 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:410 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:410.out 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:411 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:411.out 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:412 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:412.out 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:413 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:413.out 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:414 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:414.out 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:415 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:415.out 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:416 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:416.out 2024-09-21T01:52:03.347 INFO:teuthology.orchestra.run.smithi040.stdout:417 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:417.out 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:418 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:418.out 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:419 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:419.out 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:420 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:420.out 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:421 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:421.out 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:422 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:422.out 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:423 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:423.out 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:424 2024-09-21T01:52:03.348 INFO:teuthology.orchestra.run.smithi040.stdout:424.out 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:425 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:425.out 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:426 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:426.out 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:427 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:427.out 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:428 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:428.out 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:429 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:429.out 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:430 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:430.out 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:431 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:431.out 2024-09-21T01:52:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:432 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:432.out 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:433 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:433.out 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:434 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:434.out 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:435 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:435.out 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:436 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:436.out 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:437 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:437.out 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:438 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:438.out 2024-09-21T01:52:03.350 INFO:teuthology.orchestra.run.smithi040.stdout:439 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:439.out 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:440 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:440.out 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:441 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:441.out 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:442 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:442.out 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:443 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:443.out 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:444 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:444.out 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:445 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:445.out 2024-09-21T01:52:03.351 INFO:teuthology.orchestra.run.smithi040.stdout:446 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:446.out 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:447 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:447.out 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:448 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:448.out 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:449 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:449.out 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:450 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:450.out 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:451 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:451.out 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:452 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:452.out 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:453 2024-09-21T01:52:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:453.out 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:454 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:454.out 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:455 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:455.out 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:456 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:456.out 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:457 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:457.out 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:458 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:458.out 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:459 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:459.out 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:460 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:460.out 2024-09-21T01:52:03.353 INFO:teuthology.orchestra.run.smithi040.stdout:461 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:461.out 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:462 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:462.out 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:463 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:463.out 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:464 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:464.out 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:465 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:465.out 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:466 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:466.out 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:467 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:467.out 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:468 2024-09-21T01:52:03.354 INFO:teuthology.orchestra.run.smithi040.stdout:468.out 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:469 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:469.out 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:470 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:470.out 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:471 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:471.out 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:472 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:472.out 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:473 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:473.out 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:474 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:474.out 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:475 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:475.out 2024-09-21T01:52:03.355 INFO:teuthology.orchestra.run.smithi040.stdout:476 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:476.out 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:477 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:477.out 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:478 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:478.out 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:479 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:479.out 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:480 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:480.out 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:481 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:481.out 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:482 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:482.out 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:483 2024-09-21T01:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:483.out 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:484 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:484.out 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:485 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:485.out 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:486 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:486.out 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:487 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:487.out 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:488 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:488.out 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:489 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:489.out 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:490 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:490.out 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:491 2024-09-21T01:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:491.out 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:492 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:492.out 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:493 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:493.out 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:494 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:494.out 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:495 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:495.out 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:496 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:496.out 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:497 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:497.out 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:498 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:498.out 2024-09-21T01:52:03.358 INFO:teuthology.orchestra.run.smithi040.stdout:499 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:499.out 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:500 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:500.out 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:501 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:501.out 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:502 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:502.out 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:503 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:503.out 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:504 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:504.out 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:505 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:505.out 2024-09-21T01:52:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:506 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:506.out 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:507 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:507.out 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:508 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:508.out 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:509 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:509.out 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:510 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:510.out 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:511 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:511.out 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:512 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:512.out 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:513 2024-09-21T01:52:03.360 INFO:teuthology.orchestra.run.smithi040.stdout:513.out 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:514 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:514.out 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:515 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:515.out 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:516 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:516.out 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:517 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:517.out 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:518 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:518.out 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:519 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:519.out 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:520 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:520.out 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:521 2024-09-21T01:52:03.361 INFO:teuthology.orchestra.run.smithi040.stdout:521.out 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:522 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:522.out 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:523 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:523.out 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:524 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:524.out 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:525 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:525.out 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:526 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:526.out 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:527 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:527.out 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:528 2024-09-21T01:52:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:528.out 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:529 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:529.out 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:530 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:530.out 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:531 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:531.out 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:532 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:532.out 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:533 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:533.out 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:534 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:534.out 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:535 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:535.out 2024-09-21T01:52:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:536 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:536.out 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:537 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:537.out 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:538 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:538.out 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:539 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:539.out 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:540 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:540.out 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:541 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:541.out 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:542 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:542.out 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:543 2024-09-21T01:52:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:543.out 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:544 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:544.out 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:545 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:545.out 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:546 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:546.out 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:547 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:547.out 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:548 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:548.out 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:549 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:549.out 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:550 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:550.out 2024-09-21T01:52:03.365 INFO:teuthology.orchestra.run.smithi040.stdout:551 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:551.out 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:552 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:552.out 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:553 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:553.out 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:554 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:554.out 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:555 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:555.out 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:556 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:556.out 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:557 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:557.out 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:558 2024-09-21T01:52:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:558.out 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:559 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:559.out 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:560 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:560.out 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:561 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:561.out 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:562 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:562.out 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:563 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:563.out 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:564 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:564.out 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:565 2024-09-21T01:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:565.out 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:566 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:566.out 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:567 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:567.out 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:568 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:568.out 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:569 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:569.out 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:570 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:570.out 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:571 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:571.out 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:572 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:572.out 2024-09-21T01:52:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:573 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:573.out 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:574 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:574.out 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:575 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:575.out 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:576 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:576.out 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:577 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:577.out 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:578 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:578.out 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:579 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:579.out 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:580 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:580.out 2024-09-21T01:52:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:581 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:581.out 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:582 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:582.out 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:583 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:583.out 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:584 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:584.out 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:585 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:585.out 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:586 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:586.out 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:587 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:587.out 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:588 2024-09-21T01:52:03.370 INFO:teuthology.orchestra.run.smithi040.stdout:588.out 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:589 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:589.out 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:590 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:590.out 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:591 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:591.out 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:592 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:592.out 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:593 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:593.out 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:594 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:594.out 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:595 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:595.out 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:596 2024-09-21T01:52:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:596.out 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:597 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:597.out 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:598 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:598.out 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:599 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:599.out 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:600 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:600.out 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:601 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:601.out 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:602 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:602.out 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:603 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:603.out 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:604 2024-09-21T01:52:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:604.out 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:605 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:605.out 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:606 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:606.out 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:607 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:607.out 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:608 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:608.out 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:609 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:609.out 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:610 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:610.out 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:611 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:611.out 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:612 2024-09-21T01:52:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:612.out 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:613 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:613.out 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:614 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:614.out 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:615 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:615.out 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:616 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:616.out 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:617 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:617.out 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:618 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:618.out 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:619 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:619.out 2024-09-21T01:52:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:620 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:620.out 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:621 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:621.out 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:622 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:622.out 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:623 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:623.out 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:624 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:624.out 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:625 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:625.out 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:626 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:626.out 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:627 2024-09-21T01:52:03.375 INFO:teuthology.orchestra.run.smithi040.stdout:627.out 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:628 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:628.out 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:629 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:629.out 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:630 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:630.out 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:631 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:631.out 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:632 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:632.out 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:633 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:633.out 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:634 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:634.out 2024-09-21T01:52:03.376 INFO:teuthology.orchestra.run.smithi040.stdout:635 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:635.out 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:636 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:636.out 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:637 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:637.out 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:638 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:638.out 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:639 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:639.out 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:640 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:640.out 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:641 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:641.out 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:642 2024-09-21T01:52:03.377 INFO:teuthology.orchestra.run.smithi040.stdout:642.out 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:643 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:643.out 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:644 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:644.out 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:645 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:645.out 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:646 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:646.out 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:647 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:647.out 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:648 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:648.out 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:649 2024-09-21T01:52:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:649.out 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:650 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:650.out 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:651 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:651.out 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:652 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:652.out 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:653 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:653.out 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:654 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:654.out 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:655 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:655.out 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:656 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:656.out 2024-09-21T01:52:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:657 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:657.out 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:658 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:658.out 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:659 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:659.out 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:660 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:660.out 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:661 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:661.out 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:662 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:662.out 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:663 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:663.out 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:664 2024-09-21T01:52:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:664.out 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:665 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:665.out 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:666 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:666.out 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:667 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:667.out 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:668 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:668.out 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:669 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:669.out 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:670 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:670.out 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:671 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:671.out 2024-09-21T01:52:03.381 INFO:teuthology.orchestra.run.smithi040.stdout:672 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:672.out 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:673 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:673.out 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:674 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:674.out 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:675 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:675.out 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:676 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:676.out 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:677 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:677.out 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:678 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:678.out 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:679 2024-09-21T01:52:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:679.out 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:680 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:680.out 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:681 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:681.out 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:682 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:682.out 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:683 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:683.out 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:684 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:684.out 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:685 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:685.out 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:686 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:686.out 2024-09-21T01:52:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:687 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:687.out 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:688 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:688.out 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:689 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:689.out 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:690 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:690.out 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:691 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:691.out 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:692 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:692.out 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:693 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:693.out 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:694 2024-09-21T01:52:03.384 INFO:teuthology.orchestra.run.smithi040.stdout:694.out 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:695 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:695.out 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:696 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:696.out 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:697 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:697.out 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:698 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:698.out 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:699 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:699.out 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:700 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:700.out 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:701 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:701.out 2024-09-21T01:52:03.385 INFO:teuthology.orchestra.run.smithi040.stdout:702 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:702.out 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:703 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:703.out 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:704 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:704.out 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:705 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:705.out 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:706 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:706.out 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:707 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:707.out 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:708 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:708.out 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:709 2024-09-21T01:52:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:709.out 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:710 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:710.out 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:711 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:711.out 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:712 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:712.out 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:713 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:713.out 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:714 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:714.out 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:715 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:715.out 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:716 2024-09-21T01:52:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:716.out 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:717 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:717.out 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:718 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:718.out 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:719 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:719.out 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:720 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:720.out 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:721 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:721.out 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:722 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:722.out 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:723 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:723.out 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:724 2024-09-21T01:52:03.388 INFO:teuthology.orchestra.run.smithi040.stdout:724.out 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:725 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:725.out 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:726 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:726.out 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:727 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:727.out 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:728 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:728.out 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:729 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:729.out 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:730 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:730.out 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:731 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:731.out 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:732 2024-09-21T01:52:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:732.out 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:733 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:733.out 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:734 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:734.out 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:735 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:735.out 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:736 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:736.out 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:737 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:737.out 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:738 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:738.out 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:739 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:739.out 2024-09-21T01:52:03.390 INFO:teuthology.orchestra.run.smithi040.stdout:740 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:740.out 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:741 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:741.out 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:742 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:742.out 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:743 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:743.out 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:744 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:744.out 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:745 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:745.out 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:746 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:746.out 2024-09-21T01:52:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:747 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:747.out 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:748 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:748.out 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:749 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:749.out 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:750 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:750.out 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:751 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:751.out 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:752 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:752.out 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:753 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:753.out 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:754 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:754.out 2024-09-21T01:52:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:755 2024-09-21T01:52:03.393 INFO:teuthology.orchestra.run.smithi040.stdout:755.out 2024-09-21T01:52:03.393 INFO:teuthology.orchestra.run.smithi040.stdout:group.list 2024-09-21T01:52:03.393 INFO:teuthology.orchestra.run.smithi040.stdout:Makefile 2024-09-21T01:52:03.393 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-09-21T01:52:03.608 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:52:03.612 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:52:03.612 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:52:03.613 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:52:03.613 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:06.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:52:06.595 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:52:09.564 INFO:teuthology.orchestra.run.smithi040.stdout:generic/001 6s 2024-09-21T01:52:09.570 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/001 2024-09-21T01:52:09.570 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:52:09.572 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:09.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:52:09.611 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-09-21T01:52:09.812 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:52:09.816 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:52:09.816 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:52:09.817 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:52:09.817 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:10.353 INFO:teuthology.orchestra.run.smithi040.stdout:generic/002 1s 2024-09-21T01:52:10.359 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/002 2024-09-21T01:52:10.360 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:52:10.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:10.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:52:10.407 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-09-21T01:52:10.604 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:52:10.608 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:52:10.609 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:52:10.610 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:52:10.610 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:10.854 INFO:teuthology.orchestra.run.smithi040.stdout:generic/003 [not run] atime not maintained by ceph 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/003 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/003 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:10.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:52:10.873 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-09-21T01:52:11.075 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:52:11.079 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:52:11.080 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:52:11.081 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:52:11.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:11.322 INFO:teuthology.orchestra.run.smithi040.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-09-21T01:52:11.327 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/004 2024-09-21T01:52:11.327 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/004 2024-09-21T01:52:11.327 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:52:11.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:11.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:52:11.341 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-09-21T01:52:11.530 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:52:11.534 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:52:11.535 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:52:11.536 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:52:11.536 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:11.936 INFO:teuthology.orchestra.run.smithi040.stdout:generic/005 0s 2024-09-21T01:52:11.944 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/005 2024-09-21T01:52:11.944 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:52:11.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:12.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:52:12.001 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-09-21T01:52:12.213 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:52:12.218 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:52:12.218 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:52:12.219 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:52:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:36.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:52:36.742 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:52:40.070 INFO:teuthology.orchestra.run.smithi040.stdout:generic/006 28s 2024-09-21T01:52:40.077 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/006 2024-09-21T01:52:40.078 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:52:40.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:52:40.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:52:40.200 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-09-21T01:52:40.525 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:52:40.529 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:52:40.530 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:52:40.531 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:52:40.531 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:53:06.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:53:06.806 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:53:36.776 INFO:teuthology.orchestra.run.smithi040.stdout:generic/007 56s 2024-09-21T01:53:36.782 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/007 2024-09-21T01:53:36.782 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:53:36.785 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:53:36.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:53:36.820 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-09-21T01:53:37.117 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:53:37.121 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:53:37.121 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:53:37.122 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:53:37.122 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:53:37.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:53:37.127 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:53:37.411 INFO:teuthology.orchestra.run.smithi040.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-21T01:53:37.416 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/008 2024-09-21T01:53:37.416 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/008 2024-09-21T01:53:37.416 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:53:37.418 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:53:37.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:53:37.432 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-09-21T01:53:37.623 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:53:37.627 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:53:37.627 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:53:37.628 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:53:37.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:53:37.912 INFO:teuthology.orchestra.run.smithi040.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-21T01:53:37.917 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/009 2024-09-21T01:53:37.917 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/009 2024-09-21T01:53:37.917 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:53:37.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:53:37.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:53:37.936 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-09-21T01:53:38.133 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:53:38.137 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:53:38.138 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:53:38.139 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:53:38.139 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:53:38.715 INFO:teuthology.orchestra.run.smithi040.stdout:generic/010 0s 2024-09-21T01:53:38.722 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/010 2024-09-21T01:53:38.722 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:53:38.724 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:53:38.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:53:38.749 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-09-21T01:53:38.963 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:53:38.967 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:53:38.967 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:53:38.968 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:53:38.969 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:54:07.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:54:07.183 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:54:09.076 INFO:teuthology.orchestra.run.smithi040.stdout:generic/011 30s 2024-09-21T01:54:09.162 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/011 2024-09-21T01:54:09.162 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:54:09.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:54:09.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:54:09.217 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-09-21T01:54:09.466 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:54:09.470 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:54:09.471 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:54:09.472 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:54:09.472 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:54:09.799 INFO:teuthology.orchestra.run.smithi040.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:54:09.804 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/012 2024-09-21T01:54:09.804 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/012 2024-09-21T01:54:09.804 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:54:09.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:54:09.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:54:09.849 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-09-21T01:54:10.057 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:54:10.061 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:54:10.061 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:54:10.063 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:54:10.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:54:37.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:54:37.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:55:08.103 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:55:08.105 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:55:12.903 INFO:teuthology.orchestra.run.smithi040.stdout:generic/013 62s 2024-09-21T01:55:12.912 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/013 2024-09-21T01:55:12.912 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:12.917 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:12.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:12.948 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-09-21T01:55:13.229 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:13.237 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:13.237 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:13.239 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:13.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:13.853 INFO:teuthology.orchestra.run.smithi040.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-09-21T01:55:13.861 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/014 2024-09-21T01:55:13.861 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/014 2024-09-21T01:55:13.861 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:13.865 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:13.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:13.888 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-09-21T01:55:14.171 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:14.179 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:14.180 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:14.181 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:14.181 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:14.495 INFO:teuthology.orchestra.run.smithi040.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T01:55:14.503 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/015 2024-09-21T01:55:14.503 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/015 2024-09-21T01:55:14.503 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:14.507 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:14.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:14.527 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-09-21T01:55:14.810 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:14.816 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:14.816 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:14.818 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:14.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:15.258 INFO:teuthology.orchestra.run.smithi040.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:55:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/016 2024-09-21T01:55:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/016 2024-09-21T01:55:15.267 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:15.270 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:15.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:15.312 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-09-21T01:55:15.620 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:15.625 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:15.626 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:15.627 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:15.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:15.971 INFO:teuthology.orchestra.run.smithi040.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T01:55:15.979 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/017 2024-09-21T01:55:15.979 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/017 2024-09-21T01:55:15.979 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:15.983 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:16.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:16.002 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-09-21T01:55:16.288 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:16.293 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:16.294 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:16.295 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:16.296 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:16.747 INFO:teuthology.orchestra.run.smithi040.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-09-21T01:55:16.757 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/018 2024-09-21T01:55:16.757 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/018 2024-09-21T01:55:16.757 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:16.761 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:16.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:16.776 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-09-21T01:55:17.059 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:17.066 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:17.066 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:17.068 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:17.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:17.386 INFO:teuthology.orchestra.run.smithi040.stdout:generic/019 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:55:17.393 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/019 2024-09-21T01:55:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/019 2024-09-21T01:55:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:17.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:17.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:17.414 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-09-21T01:55:17.701 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:17.706 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:17.707 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:17.708 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:17.708 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:22.104 INFO:teuthology.orchestra.run.smithi040.stdout:generic/020 4s 2024-09-21T01:55:22.180 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/020 2024-09-21T01:55:22.180 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:22.183 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:22.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:22.221 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-09-21T01:55:22.544 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:22.549 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:22.550 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:22.551 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:22.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:22.984 INFO:teuthology.orchestra.run.smithi040.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:55:22.992 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/021 2024-09-21T01:55:22.993 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/021 2024-09-21T01:55:22.993 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:22.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:23.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:23.042 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-09-21T01:55:23.373 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:23.379 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:23.380 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:23.381 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:23.381 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:23.834 INFO:teuthology.orchestra.run.smithi040.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:55:23.841 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/022 2024-09-21T01:55:23.841 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/022 2024-09-21T01:55:23.841 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:23.844 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:23.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:23.882 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-09-21T01:55:24.214 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:24.221 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:24.221 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:24.223 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:24.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:25.666 INFO:teuthology.orchestra.run.smithi040.stdout:generic/023 1s 2024-09-21T01:55:25.674 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/023 2024-09-21T01:55:25.674 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:25.678 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:25.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:25.762 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-09-21T01:55:26.082 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:26.087 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:26.087 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:26.088 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:26.088 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:26.457 INFO:teuthology.orchestra.run.smithi040.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-09-21T01:55:26.465 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/024 2024-09-21T01:55:26.465 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/024 2024-09-21T01:55:26.465 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:26.468 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:26.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:26.511 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-09-21T01:55:26.847 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:26.852 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:26.853 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:26.854 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:26.854 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-09-21T01:55:27.211 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/025 2024-09-21T01:55:27.211 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/025 2024-09-21T01:55:27.211 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:27.215 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:27.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:27.246 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-09-21T01:55:27.585 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:27.591 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:27.593 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:27.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:27.968 INFO:teuthology.orchestra.run.smithi040.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-09-21T01:55:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/026 2024-09-21T01:55:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/026 2024-09-21T01:55:27.976 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:27.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:28.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:28.005 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-09-21T01:55:28.290 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:28.296 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:28.298 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:28.298 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:28.617 INFO:teuthology.orchestra.run.smithi040.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T01:55:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/027 2024-09-21T01:55:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/027 2024-09-21T01:55:28.624 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:28.629 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:28.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:28.646 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-09-21T01:55:28.926 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:28.932 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:28.934 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:28.934 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:34.267 INFO:teuthology.orchestra.run.smithi040.stdout:generic/028 5s 2024-09-21T01:55:34.277 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/028 2024-09-21T01:55:34.278 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:34.281 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:34.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:34.306 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-09-21T01:55:34.583 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:34.589 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:34.590 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:34.591 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:34.591 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:38.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:55:38.179 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:55:38.239 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T01:55:38.238+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 122816) UID: 0 2024-09-21T01:55:38.239 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T01:55:38.238+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 122816) UID: 0 2024-09-21T01:55:39.873 INFO:teuthology.orchestra.run.smithi040.stdout:generic/029 5s 2024-09-21T01:55:39.886 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/029 2024-09-21T01:55:39.886 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:39.891 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:39.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:39.905 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-09-21T01:55:40.255 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:40.262 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:40.262 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:40.264 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:40.264 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:42.334 INFO:teuthology.orchestra.run.smithi040.stdout:generic/030 2s 2024-09-21T01:55:42.345 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/030 2024-09-21T01:55:42.345 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:42.349 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:42.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:42.362 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-09-21T01:55:42.659 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:42.664 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:42.664 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:42.666 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:42.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:43.102 INFO:teuthology.orchestra.run.smithi040.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-09-21T01:55:43.109 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/031 2024-09-21T01:55:43.109 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/031 2024-09-21T01:55:43.109 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:43.112 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:43.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:43.135 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-09-21T01:55:43.432 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:43.437 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:43.438 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:43.439 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:43.440 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:43.806 INFO:teuthology.orchestra.run.smithi040.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:55:43.816 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/032 2024-09-21T01:55:43.816 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/032 2024-09-21T01:55:43.816 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:43.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:43.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:43.840 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-09-21T01:55:44.141 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:44.147 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:44.148 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:44.150 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:44.150 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:44.584 INFO:teuthology.orchestra.run.smithi040.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-21T01:55:44.592 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/033 2024-09-21T01:55:44.592 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/033 2024-09-21T01:55:44.593 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:44.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:44.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:44.626 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-09-21T01:55:44.938 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:44.943 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:44.944 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:44.945 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:44.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:45.306 INFO:teuthology.orchestra.run.smithi040.stdout:generic/034 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:55:45.313 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/034 2024-09-21T01:55:45.313 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/034 2024-09-21T01:55:45.313 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:45.320 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:45.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:45.335 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-09-21T01:55:45.639 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:45.645 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:45.646 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:45.648 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:45.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:46.102 INFO:teuthology.orchestra.run.smithi040.stdout:generic/035 1s 2024-09-21T01:55:46.112 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/035 2024-09-21T01:55:46.112 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:46.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:46.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:46.161 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-09-21T01:55:46.527 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:46.533 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:46.534 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:46.535 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:46.535 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:57.005 INFO:teuthology.orchestra.run.smithi040.stdout:generic/036 11s 2024-09-21T01:55:57.015 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/036 2024-09-21T01:55:57.015 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:55:57.019 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:55:57.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:55:57.054 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-09-21T01:55:57.447 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:55:57.452 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:55:57.453 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:55:57.455 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:55:57.455 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:03.049 INFO:teuthology.orchestra.run.smithi040.stdout:generic/037 6s 2024-09-21T01:56:03.060 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/037 2024-09-21T01:56:03.060 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:03.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:03.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:03.078 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-09-21T01:56:03.391 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:03.396 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:03.397 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:03.398 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:03.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:03.762 INFO:teuthology.orchestra.run.smithi040.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:56:03.769 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/038 2024-09-21T01:56:03.769 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/038 2024-09-21T01:56:03.769 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:03.773 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:03.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:03.793 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-09-21T01:56:04.113 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:04.119 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:04.119 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:04.121 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:04.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:04.491 INFO:teuthology.orchestra.run.smithi040.stdout:generic/039 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:56:04.497 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/039 2024-09-21T01:56:04.498 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/039 2024-09-21T01:56:04.498 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:04.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:04.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:04.530 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-09-21T01:56:04.864 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:04.870 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:04.871 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:04.873 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:04.873 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:generic/040 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:56:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/040 2024-09-21T01:56:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/040 2024-09-21T01:56:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:05.268 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:05.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:05.296 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-09-21T01:56:05.602 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:05.610 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:05.611 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:05.613 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:05.613 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:06.004 INFO:teuthology.orchestra.run.smithi040.stdout:generic/041 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:56:06.011 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/041 2024-09-21T01:56:06.012 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/041 2024-09-21T01:56:06.012 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:06.016 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:06.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:06.039 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-09-21T01:56:06.347 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:06.352 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:06.354 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:06.356 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:06.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:06.820 INFO:teuthology.orchestra.run.smithi040.stdout:generic/042 [not run] ceph does not support shutdown 2024-09-21T01:56:06.831 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/042 2024-09-21T01:56:06.832 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/042 2024-09-21T01:56:06.832 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:06.836 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:06.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:06.854 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-09-21T01:56:07.171 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:07.177 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:07.178 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:07.180 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:07.180 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:07.664 INFO:teuthology.orchestra.run.smithi040.stdout:generic/043 [not run] ceph does not support shutdown 2024-09-21T01:56:07.675 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/043 2024-09-21T01:56:07.675 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/043 2024-09-21T01:56:07.675 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:07.679 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:07.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:07.696 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-09-21T01:56:08.012 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:08.017 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:08.018 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:08.019 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:08.019 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:08.503 INFO:teuthology.orchestra.run.smithi040.stdout:generic/044 [not run] ceph does not support shutdown 2024-09-21T01:56:08.516 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/044 2024-09-21T01:56:08.516 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/044 2024-09-21T01:56:08.516 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:08.520 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:08.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:08.538 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-09-21T01:56:08.837 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:08.844 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:08.845 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:08.846 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:08.846 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:09.345 INFO:teuthology.orchestra.run.smithi040.stdout:generic/045 [not run] ceph does not support shutdown 2024-09-21T01:56:09.360 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/045 2024-09-21T01:56:09.360 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/045 2024-09-21T01:56:09.360 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:09.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:09.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:09.381 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-09-21T01:56:09.671 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:09.677 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:09.678 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:09.679 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:09.679 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:10.156 INFO:teuthology.orchestra.run.smithi040.stdout:generic/046 [not run] ceph does not support shutdown 2024-09-21T01:56:10.172 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/046 2024-09-21T01:56:10.172 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/046 2024-09-21T01:56:10.172 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:10.175 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:10.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:10.194 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-09-21T01:56:10.504 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:10.510 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:10.511 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:10.513 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:10.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:11.002 INFO:teuthology.orchestra.run.smithi040.stdout:generic/047 [not run] ceph does not support shutdown 2024-09-21T01:56:11.015 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/047 2024-09-21T01:56:11.015 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/047 2024-09-21T01:56:11.015 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:11.018 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:11.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:11.036 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-09-21T01:56:11.358 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:11.364 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:11.364 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:11.366 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:11.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:11.853 INFO:teuthology.orchestra.run.smithi040.stdout:generic/048 [not run] ceph does not support shutdown 2024-09-21T01:56:11.876 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/048 2024-09-21T01:56:11.877 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/048 2024-09-21T01:56:11.877 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:11.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:11.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:11.897 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-09-21T01:56:12.205 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:12.211 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:12.212 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:12.213 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:12.213 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:12.705 INFO:teuthology.orchestra.run.smithi040.stdout:generic/049 [not run] ceph does not support shutdown 2024-09-21T01:56:12.719 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/049 2024-09-21T01:56:12.719 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/049 2024-09-21T01:56:12.719 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:12.723 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:12.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:12.741 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-09-21T01:56:13.055 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:13.065 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:13.067 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:13.068 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:13.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:13.626 INFO:teuthology.orchestra.run.smithi040.stdout:generic/050 [not run] ceph does not support shutdown 2024-09-21T01:56:13.642 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/050 2024-09-21T01:56:13.642 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/050 2024-09-21T01:56:13.642 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:13.645 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:13.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:13.661 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-09-21T01:56:13.972 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:13.980 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:13.980 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:13.981 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:13.981 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:14.455 INFO:teuthology.orchestra.run.smithi040.stdout:generic/051 [not run] ceph does not support shutdown 2024-09-21T01:56:14.462 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/051 2024-09-21T01:56:14.462 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/051 2024-09-21T01:56:14.462 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:14.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:14.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:14.483 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-09-21T01:56:14.771 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:14.779 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:14.780 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:14.781 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:14.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:15.255 INFO:teuthology.orchestra.run.smithi040.stdout:generic/052 [not run] ceph does not support shutdown 2024-09-21T01:56:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/052 2024-09-21T01:56:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/052 2024-09-21T01:56:15.279 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:15.282 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:15.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:15.298 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-09-21T01:56:15.594 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:15.599 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:15.600 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:15.602 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:15.602 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:16.393 INFO:teuthology.orchestra.run.smithi040.stdout:generic/053 1s 2024-09-21T01:56:16.403 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/053 2024-09-21T01:56:16.406 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:16.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:16.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:16.424 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-09-21T01:56:16.795 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:16.802 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:16.802 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:16.804 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:16.804 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:17.327 INFO:teuthology.orchestra.run.smithi040.stdout:generic/054 [not run] ceph does not support shutdown 2024-09-21T01:56:17.349 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/054 2024-09-21T01:56:17.349 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/054 2024-09-21T01:56:17.349 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:17.352 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:17.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:17.369 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-09-21T01:56:17.683 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:17.688 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:17.689 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:17.690 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:17.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:18.163 INFO:teuthology.orchestra.run.smithi040.stdout:generic/055 [not run] ceph does not support shutdown 2024-09-21T01:56:18.186 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/055 2024-09-21T01:56:18.186 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/055 2024-09-21T01:56:18.187 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:18.190 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:18.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:18.206 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-09-21T01:56:18.508 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:18.513 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:18.514 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:18.516 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:18.516 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:18.893 INFO:teuthology.orchestra.run.smithi040.stdout:generic/056 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:56:18.902 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/056 2024-09-21T01:56:18.902 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/056 2024-09-21T01:56:18.902 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:18.906 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:18.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:18.932 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-09-21T01:56:19.244 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:19.251 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:19.251 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:19.253 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:19.253 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:19.644 INFO:teuthology.orchestra.run.smithi040.stdout:generic/057 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:56:19.651 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/057 2024-09-21T01:56:19.651 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/057 2024-09-21T01:56:19.651 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:19.654 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:19.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:19.675 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-09-21T01:56:19.988 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:19.995 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:19.995 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:19.996 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:19.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:20.460 INFO:teuthology.orchestra.run.smithi040.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:56:20.468 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/058 2024-09-21T01:56:20.468 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/058 2024-09-21T01:56:20.468 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:20.472 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:20.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:20.529 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-09-21T01:56:20.921 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:20.927 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:20.928 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:20.929 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:20.930 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:21.279 INFO:teuthology.orchestra.run.smithi040.stdout:generic/059 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:56:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/059 2024-09-21T01:56:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/059 2024-09-21T01:56:21.286 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:21.290 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:21.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:21.310 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-09-21T01:56:21.620 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:21.626 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:21.626 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:21.628 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:21.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:22.108 INFO:teuthology.orchestra.run.smithi040.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:56:22.115 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/060 2024-09-21T01:56:22.115 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/060 2024-09-21T01:56:22.115 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:22.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:22.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:22.176 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-09-21T01:56:22.568 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:22.574 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:22.574 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:22.576 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:22.576 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:23.053 INFO:teuthology.orchestra.run.smithi040.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:56:23.060 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/061 2024-09-21T01:56:23.061 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/061 2024-09-21T01:56:23.061 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:23.067 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:23.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:23.108 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-09-21T01:56:23.505 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:23.512 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:23.513 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:23.514 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:23.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:25.616 INFO:teuthology.orchestra.run.smithi040.stdout:generic/062 2s 2024-09-21T01:56:25.630 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/062 2024-09-21T01:56:25.630 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:25.634 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:25.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:25.653 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-09-21T01:56:26.032 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:26.038 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:26.038 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:26.040 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:26.041 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:26.586 INFO:teuthology.orchestra.run.smithi040.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:56:26.592 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/063 2024-09-21T01:56:26.592 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/063 2024-09-21T01:56:26.592 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:26.596 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:26.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:26.649 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-09-21T01:56:27.041 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:27.047 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:27.047 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:27.049 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:27.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T01:56:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/064 2024-09-21T01:56:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/064 2024-09-21T01:56:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:27.437 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:27.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:27.464 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-09-21T01:56:27.777 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:27.784 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:27.785 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:27.786 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:27.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:28.161 INFO:teuthology.orchestra.run.smithi040.stdout:generic/065 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:56:28.168 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/065 2024-09-21T01:56:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/065 2024-09-21T01:56:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:28.172 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:28.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:28.207 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-09-21T01:56:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:28.518 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:28.519 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:28.521 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:28.882 INFO:teuthology.orchestra.run.smithi040.stdout:generic/066 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:56:28.891 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/066 2024-09-21T01:56:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/066 2024-09-21T01:56:28.893 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:28.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:28.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:28.919 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-09-21T01:56:29.225 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:29.231 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:29.232 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:29.234 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:29.636 INFO:teuthology.orchestra.run.smithi040.stdout:generic/067 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:56:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/067 2024-09-21T01:56:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/067 2024-09-21T01:56:29.643 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:29.647 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:29.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:29.674 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-09-21T01:56:29.988 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:29.996 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:29.998 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:29.999 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:30.000 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:30.363 INFO:teuthology.orchestra.run.smithi040.stdout:generic/068 [not run] ceph does not support freezing 2024-09-21T01:56:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/068 2024-09-21T01:56:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/068 2024-09-21T01:56:30.372 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:30.375 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:30.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:30.397 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-09-21T01:56:30.699 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:30.708 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:30.708 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:39.430 INFO:teuthology.orchestra.run.smithi040.stdout:generic/069 9s 2024-09-21T01:56:39.445 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/069 2024-09-21T01:56:39.445 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:56:39.449 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:56:39.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:56:39.473 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-09-21T01:56:39.829 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:56:39.834 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:56:39.834 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:56:39.835 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:56:39.835 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:04.990 INFO:teuthology.orchestra.run.smithi040.stdout:generic/070 24s 2024-09-21T01:57:05.003 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/070 2024-09-21T01:57:05.003 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:05.006 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:05.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:05.128 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-09-21T01:57:05.476 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:05.483 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:05.483 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:05.484 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:05.485 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:05.843 INFO:teuthology.orchestra.run.smithi040.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-21T01:57:05.851 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/071 2024-09-21T01:57:05.851 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/071 2024-09-21T01:57:05.852 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:05.855 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:05.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:05.873 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-09-21T01:57:06.201 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:06.207 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:06.207 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:06.209 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:06.209 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:06.641 INFO:teuthology.orchestra.run.smithi040.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-09-21T01:57:06.649 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/072 2024-09-21T01:57:06.649 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/072 2024-09-21T01:57:06.649 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:06.654 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:06.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:06.675 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-09-21T01:57:06.970 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:06.975 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:06.975 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:06.976 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:06.976 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:07.331 INFO:teuthology.orchestra.run.smithi040.stdout:generic/073 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:57:07.338 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/073 2024-09-21T01:57:07.338 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/073 2024-09-21T01:57:07.338 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:07.342 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:07.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:07.359 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-09-21T01:57:07.664 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:07.670 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:07.670 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:07.672 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:07.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:25.938 INFO:teuthology.orchestra.run.smithi040.stdout:generic/074 18s 2024-09-21T01:57:25.947 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/074 2024-09-21T01:57:25.947 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:25.950 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:26.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:26.928 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-09-21T01:57:27.398 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:27.403 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:27.404 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:27.405 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:27.405 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout:generic/075 23s 2024-09-21T01:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/075 2024-09-21T01:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:50.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:50.710 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-09-21T01:57:51.148 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:51.154 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:51.154 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:51.155 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:51.156 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:51.505 INFO:teuthology.orchestra.run.smithi040.stdout:generic/076 [not run] require 172.21.15.40:6789:/scratch to be local device 2024-09-21T01:57:51.512 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/076 2024-09-21T01:57:51.513 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/076 2024-09-21T01:57:51.513 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:51.516 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:51.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:51.538 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-09-21T01:57:51.853 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:51.858 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:51.859 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:51.860 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:51.860 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:53.087 INFO:teuthology.orchestra.run.smithi040.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T01:57:53.093 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/077 2024-09-21T01:57:53.093 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/077 2024-09-21T01:57:53.093 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:53.097 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:53.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:53.147 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-09-21T01:57:53.590 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:53.596 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:53.597 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:53.598 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:53.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:53.986 INFO:teuthology.orchestra.run.smithi040.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-09-21T01:57:53.994 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/078 2024-09-21T01:57:53.994 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/078 2024-09-21T01:57:53.994 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:53.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:54.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:54.044 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-09-21T01:57:54.481 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:54.486 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:54.487 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:54.488 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:54.488 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:54.873 INFO:teuthology.orchestra.run.smithi040.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-09-21T01:57:54.880 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/079 2024-09-21T01:57:54.880 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/079 2024-09-21T01:57:54.880 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:54.882 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:54.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:54.909 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-09-21T01:57:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:55.220 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:55.220 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:55.222 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:57.639 INFO:teuthology.orchestra.run.smithi040.stdout:generic/080 2s 2024-09-21T01:57:57.647 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/080 2024-09-21T01:57:57.647 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:57.652 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:57.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:57.682 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-09-21T01:57:58.017 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:58.024 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:58.025 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:58.026 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:58.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:58.446 INFO:teuthology.orchestra.run.smithi040.stdout:generic/081 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:57:58.454 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/081 2024-09-21T01:57:58.454 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/081 2024-09-21T01:57:58.454 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:58.459 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:58.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:58.481 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-09-21T01:57:58.815 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:58.823 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:58.824 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:58.825 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:58.826 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:59.225 INFO:teuthology.orchestra.run.smithi040.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T01:57:59.232 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/082 2024-09-21T01:57:59.232 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/082 2024-09-21T01:57:59.232 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:57:59.236 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:59.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:57:59.257 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-09-21T01:57:59.602 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:57:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:57:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:57:59.608 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:57:59.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:57:59.998 INFO:teuthology.orchestra.run.smithi040.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T01:58:00.005 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/083 2024-09-21T01:58:00.005 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/083 2024-09-21T01:58:00.005 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:58:00.009 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:00.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:58:00.025 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-09-21T01:58:00.315 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:58:00.319 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:58:00.320 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:58:00.321 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:58:00.322 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:06.002 INFO:teuthology.orchestra.run.smithi040.stdout:generic/084 5s 2024-09-21T01:58:06.020 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/084 2024-09-21T01:58:06.020 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:58:06.024 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:06.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:58:06.038 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-09-21T01:58:06.424 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:58:06.429 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:58:06.430 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:58:06.431 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:58:06.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:06.809 INFO:teuthology.orchestra.run.smithi040.stdout:generic/085 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T01:58:06.815 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/085 2024-09-21T01:58:06.815 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/085 2024-09-21T01:58:06.815 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:58:06.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:06.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:58:06.840 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-09-21T01:58:07.144 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:58:07.151 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:58:07.153 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:58:07.154 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:58:07.154 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:07.508 INFO:teuthology.orchestra.run.smithi040.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T01:58:07.515 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/086 2024-09-21T01:58:07.515 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/086 2024-09-21T01:58:07.515 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:58:07.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:07.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:58:07.540 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-09-21T01:58:07.835 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:58:07.841 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:58:07.842 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:58:07.843 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:58:07.844 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:08.311 INFO:teuthology.orchestra.run.smithi040.stdout:generic/087 1s 2024-09-21T01:58:08.322 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/087 2024-09-21T01:58:08.322 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:58:08.326 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:08.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:58:08.396 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-09-21T01:58:08.842 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:58:08.848 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:58:08.849 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:58:08.850 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:58:08.850 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:09.263 INFO:teuthology.orchestra.run.smithi040.stdout:generic/088 0s 2024-09-21T01:58:09.333 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/088 2024-09-21T01:58:09.334 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T01:58:09.337 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:09.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T01:58:09.381 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-09-21T01:58:09.820 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T01:58:09.825 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T01:58:09.826 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T01:58:09.827 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T01:58:09.827 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T01:58:47.872 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:58:47.876 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:59:18.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:59:18.307 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:59:48.376 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T01:59:48.381 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:00:18.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:00:18.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:00:48.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:00:48.573 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:01:18.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:01:18.640 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:01:48.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:01:48.714 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:02:18.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:02:18.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:02:18.836 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T02:02:18.836+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 165602) UID: 0 2024-09-21T02:02:18.840 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T02:02:18.836+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 165602) UID: 0 2024-09-21T02:05:21.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:05:21.538 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:05:51.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:05:51.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:05:51.836 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T02:05:51.835+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 167666) UID: 0 2024-09-21T02:05:51.836 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T02:05:51.835+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 167666) UID: 0 2024-09-21T02:07:37.467 INFO:teuthology.orchestra.run.smithi040.stdout:generic/089 568s 2024-09-21T02:07:37.496 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/089 2024-09-21T02:07:37.496 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:07:37.499 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:07:38.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:07:38.408 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-09-21T02:07:39.319 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:07:39.325 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:07:39.328 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:07:39.329 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:07:39.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:07:39.792 INFO:teuthology.orchestra.run.smithi040.stdout:generic/090 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:07:39.796 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/090 2024-09-21T02:07:39.797 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/090 2024-09-21T02:07:39.797 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:07:39.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:07:39.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:07:39.814 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-09-21T02:07:40.015 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:07:40.019 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:07:40.019 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:07:40.020 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:07:40.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:08:44.008 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:08:44.011 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:09:14.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:09:14.065 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:09:21.750 INFO:teuthology.orchestra.run.smithi040.stdout:generic/091 101s 2024-09-21T02:09:21.755 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/091 2024-09-21T02:09:21.755 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:21.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:21.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:21.804 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-09-21T02:09:22.228 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:22.232 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:22.232 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:22.233 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:09:22.233 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:22.490 INFO:teuthology.orchestra.run.smithi040.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:09:22.495 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/092 2024-09-21T02:09:22.495 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/092 2024-09-21T02:09:22.495 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:22.497 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:22.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:22.513 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-09-21T02:09:22.707 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:22.711 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:22.711 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:22.712 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:09:22.712 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:23.270 INFO:teuthology.orchestra.run.smithi040.stdout:generic/093 1s 2024-09-21T02:09:23.277 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/093 2024-09-21T02:09:23.277 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:23.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:23.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:23.348 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-09-21T02:09:23.788 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:23.794 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:23.794 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:23.794 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:09:23.794 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:24.084 INFO:teuthology.orchestra.run.smithi040.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T02:09:24.089 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/094 2024-09-21T02:09:24.089 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/094 2024-09-21T02:09:24.090 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:24.092 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:24.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:24.141 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-09-21T02:09:24.565 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:24.569 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:24.569 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:24.570 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:09:24.570 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:36.485 INFO:teuthology.orchestra.run.smithi040.stdout:generic/095 12s 2024-09-21T02:09:36.493 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/095 2024-09-21T02:09:36.493 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:36.496 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:36.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:36.506 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-09-21T02:09:36.710 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:36.714 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:36.714 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:36.715 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:09:36.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:37.024 INFO:teuthology.orchestra.run.smithi040.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-21T02:09:37.029 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/096 2024-09-21T02:09:37.029 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/096 2024-09-21T02:09:37.029 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:37.031 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:37.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:37.049 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-09-21T02:09:37.251 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:37.254 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:37.255 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:37.255 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:09:37.256 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:37.952 INFO:teuthology.orchestra.run.smithi040.stdout:generic/097 0s 2024-09-21T02:09:37.961 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/097 2024-09-21T02:09:37.962 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:37.965 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:37.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:37.982 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-09-21T02:09:38.182 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:38.186 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:38.187 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:38.188 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:09:38.188 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:39.975 INFO:teuthology.orchestra.run.smithi040.stdout:generic/098 1s 2024-09-21T02:09:39.982 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/098 2024-09-21T02:09:39.982 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:39.984 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:39.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:39.994 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-09-21T02:09:40.192 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:40.196 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:40.196 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:40.197 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:09:40.197 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:41.060 INFO:teuthology.orchestra.run.smithi040.stdout:generic/099 1s 2024-09-21T02:09:41.067 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/099 2024-09-21T02:09:41.067 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:41.069 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:41.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:41.131 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-09-21T02:09:41.553 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:41.557 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:41.557 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:41.558 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:09:41.558 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:44.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:09:44.139 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:09:52.922 INFO:teuthology.orchestra.run.smithi040.stdout:generic/100 11s 2024-09-21T02:09:52.928 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/100 2024-09-21T02:09:52.928 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:09:52.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:09:56.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:09:56.383 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-09-21T02:09:56.767 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:09:56.771 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:09:56.771 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:09:56.772 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:05.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:05.098 INFO:teuthology.orchestra.run.smithi040.stdout:generic/101 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:10:05.098 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/101 2024-09-21T02:10:05.098 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/101 2024-09-21T02:10:05.098 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:05.098 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:05.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:05.099 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-09-21T02:10:05.313 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:05.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:05.562 INFO:teuthology.orchestra.run.smithi040.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:10:05.567 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/102 2024-09-21T02:10:05.567 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/102 2024-09-21T02:10:05.567 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:05.570 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:05.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:05.582 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-09-21T02:10:05.780 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:05.784 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:05.785 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:05.786 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:05.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:06.046 INFO:teuthology.orchestra.run.smithi040.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:10:06.051 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/103 2024-09-21T02:10:06.051 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/103 2024-09-21T02:10:06.051 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:06.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:06.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:06.112 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-09-21T02:10:06.552 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:06.556 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:06.556 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:06.557 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:06.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:06.813 INFO:teuthology.orchestra.run.smithi040.stdout:generic/104 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:10:06.817 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/104 2024-09-21T02:10:06.818 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/104 2024-09-21T02:10:06.818 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:06.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:06.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:06.836 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-09-21T02:10:07.037 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:07.041 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:07.042 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:07.043 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:07.043 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:07.505 INFO:teuthology.orchestra.run.smithi040.stdout:generic/105 0s 2024-09-21T02:10:07.519 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/105 2024-09-21T02:10:07.519 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:07.525 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:07.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:07.546 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-09-21T02:10:07.944 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:07.948 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:07.948 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:07.949 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:07.949 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:08.218 INFO:teuthology.orchestra.run.smithi040.stdout:generic/106 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:10:08.223 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/106 2024-09-21T02:10:08.223 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/106 2024-09-21T02:10:08.223 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:08.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:08.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:08.241 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-09-21T02:10:08.443 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:08.448 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:08.448 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:08.449 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:08.449 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:08.709 INFO:teuthology.orchestra.run.smithi040.stdout:generic/107 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:10:08.715 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/107 2024-09-21T02:10:08.715 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/107 2024-09-21T02:10:08.715 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:08.717 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:08.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:08.733 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-09-21T02:10:08.933 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:08.937 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:08.937 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:08.939 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:08.939 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:09.283 INFO:teuthology.orchestra.run.smithi040.stdout:generic/108 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:10:09.288 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/108 2024-09-21T02:10:09.288 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/108 2024-09-21T02:10:09.288 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:09.290 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:09.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:09.303 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-09-21T02:10:09.509 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:09.513 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:09.514 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:09.515 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:09.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:14.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:10:14.465 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:10:21.391 INFO:teuthology.orchestra.run.smithi040.stdout:generic/109 12s 2024-09-21T02:10:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/109 2024-09-21T02:10:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:21.402 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:21.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:21.411 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-09-21T02:10:22.217 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:22.221 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:22.221 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:22.222 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:22.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:41.888 INFO:teuthology.orchestra.run.smithi040.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:10:41.898 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/110 2024-09-21T02:10:41.898 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/110 2024-09-21T02:10:41.898 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:41.901 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:41.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:41.996 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-09-21T02:10:42.565 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:42.570 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:42.572 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:42.574 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:42.574 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:42.979 INFO:teuthology.orchestra.run.smithi040.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:10:42.984 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/111 2024-09-21T02:10:42.984 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/111 2024-09-21T02:10:42.984 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:42.986 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:43.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:43.050 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-09-21T02:10:43.461 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:10:43.465 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:10:43.466 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:10:43.467 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:10:43.467 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:44.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:10:44.527 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:10:59.566 INFO:teuthology.orchestra.run.smithi040.stdout:generic/112 16s 2024-09-21T02:10:59.573 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/112 2024-09-21T02:10:59.573 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:10:59.575 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:10:59.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:10:59.633 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-09-21T02:11:00.065 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:00.069 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:00.070 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:00.070 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:00.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:14.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:11:14.757 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:11:16.655 INFO:teuthology.orchestra.run.smithi040.stdout:generic/113 16s 2024-09-21T02:11:16.662 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/113 2024-09-21T02:11:16.662 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:16.664 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:16.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:16.717 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-09-21T02:11:17.214 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:17.230 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:17.231 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:17.234 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:17.234 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:17.537 INFO:teuthology.orchestra.run.smithi040.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-09-21T02:11:17.542 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/114 2024-09-21T02:11:17.542 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/114 2024-09-21T02:11:17.542 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:17.545 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:17.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:17.566 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-09-21T02:11:17.764 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:17.768 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:17.769 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:17.770 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:17.770 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:18.035 INFO:teuthology.orchestra.run.smithi040.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:11:18.040 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/115 2024-09-21T02:11:18.040 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/115 2024-09-21T02:11:18.040 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:18.042 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:18.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:18.106 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-09-21T02:11:18.538 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:18.542 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:18.543 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:18.544 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:18.544 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:18.813 INFO:teuthology.orchestra.run.smithi040.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:11:18.818 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/116 2024-09-21T02:11:18.819 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/116 2024-09-21T02:11:18.819 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:18.821 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:18.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:18.877 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-09-21T02:11:19.309 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:19.313 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:19.313 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:19.314 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:19.314 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:33.172 INFO:teuthology.orchestra.run.smithi040.stdout:generic/117 14s 2024-09-21T02:11:33.179 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/117 2024-09-21T02:11:33.180 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:33.182 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:33.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:33.192 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-09-21T02:11:33.403 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:33.407 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:33.408 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:33.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:34.109 INFO:teuthology.orchestra.run.smithi040.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:11:34.114 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/118 2024-09-21T02:11:34.114 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/118 2024-09-21T02:11:34.114 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:34.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:34.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:34.175 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-09-21T02:11:34.605 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:34.609 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:34.609 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:34.610 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:34.610 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:34.874 INFO:teuthology.orchestra.run.smithi040.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:11:34.878 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/119 2024-09-21T02:11:34.879 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/119 2024-09-21T02:11:34.879 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:34.881 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:34.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:34.942 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-09-21T02:11:35.360 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:35.364 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:35.365 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:35.366 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:35.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:35.597 INFO:teuthology.orchestra.run.smithi040.stdout:generic/120 [not run] atime not maintained by ceph 2024-09-21T02:11:35.602 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/120 2024-09-21T02:11:35.602 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/120 2024-09-21T02:11:35.602 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:35.605 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:35.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:35.617 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-09-21T02:11:35.820 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:35.824 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:35.824 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:35.825 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:35.825 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:36.091 INFO:teuthology.orchestra.run.smithi040.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-21T02:11:36.096 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/121 2024-09-21T02:11:36.096 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/121 2024-09-21T02:11:36.096 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:36.099 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:36.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:36.148 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-09-21T02:11:36.593 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:36.597 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:36.597 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:36.598 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:36.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:36.869 INFO:teuthology.orchestra.run.smithi040.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-21T02:11:36.874 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/122 2024-09-21T02:11:36.874 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/122 2024-09-21T02:11:36.874 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:36.877 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:36.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:36.950 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-09-21T02:11:37.379 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:37.383 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:37.383 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:37.385 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:37.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:37.925 INFO:teuthology.orchestra.run.smithi040.stdout:generic/123 0s 2024-09-21T02:11:37.932 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/123 2024-09-21T02:11:37.932 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:37.934 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:37.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:37.995 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-09-21T02:11:38.422 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:38.426 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:38.426 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:38.427 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:38.427 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:40.482 INFO:teuthology.orchestra.run.smithi040.stdout:generic/124 2s 2024-09-21T02:11:40.494 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/124 2024-09-21T02:11:40.495 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:11:40.505 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:41.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:11:41.093 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-09-21T02:11:41.496 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:11:41.500 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:11:41.500 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:11:41.501 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:11:41.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:11:44.861 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:11:44.864 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:12:15.007 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:12:15.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:12:42.953 INFO:teuthology.orchestra.run.smithi040.stdout:generic/125 61s 2024-09-21T02:12:42.960 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/125 2024-09-21T02:12:42.960 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:12:42.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:12:43.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:12:43.012 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-09-21T02:12:43.451 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:12:43.455 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:12:43.455 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:12:43.456 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:12:43.456 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:12:43.913 INFO:teuthology.orchestra.run.smithi040.stdout:generic/126 0s 2024-09-21T02:12:43.920 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/126 2024-09-21T02:12:43.920 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:12:43.923 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:12:44.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:12:44.009 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-09-21T02:12:44.440 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:12:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:12:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:12:44.445 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:12:44.446 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:12:45.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:12:45.174 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:13:15.315 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:13:15.318 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:13:45.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:13:45.381 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:14:15.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:14:15.461 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:14:45.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:14:45.518 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:15:15.571 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:15:15.574 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:15:45.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:15:45.633 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:16:15.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:16:15.762 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:16:45.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:16:45.818 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:17:16.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:17:16.216 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:17:46.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:17:46.271 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:18:16.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:18:16.364 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:18:46.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:18:46.792 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:19:16.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:19:16.891 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:19:16.922 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T02:19:16.921+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 201393) UID: 0 2024-09-21T02:19:16.922 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T02:19:16.921+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 201393) UID: 0 2024-09-21T02:21:59.954 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:21:59.957 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:22:30.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:22:30.073 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:22:54.071 INFO:teuthology.orchestra.run.smithi040.stdout:generic/127 610s 2024-09-21T02:22:54.077 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/127 2024-09-21T02:22:54.077 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:22:54.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:22:54.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:22:54.138 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-09-21T02:22:54.579 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:22:54.583 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:22:54.584 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:22:54.584 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:22:54.585 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:22:55.718 INFO:teuthology.orchestra.run.smithi040.stdout:generic/128 1s 2024-09-21T02:22:55.766 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/128 2024-09-21T02:22:55.766 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:22:55.768 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:22:55.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:22:55.778 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-09-21T02:22:55.972 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:22:55.976 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:22:55.977 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:22:55.978 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:22:55.978 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:22:56.237 INFO:teuthology.orchestra.run.smithi040.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-09-21T02:22:56.242 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/129 2024-09-21T02:22:56.242 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/129 2024-09-21T02:22:56.243 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:22:56.245 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:22:56.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:22:56.267 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-09-21T02:22:56.457 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:22:56.461 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:22:56.461 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:22:56.462 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:22:56.462 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:22:56.711 INFO:teuthology.orchestra.run.smithi040.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-09-21T02:22:56.716 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/130 2024-09-21T02:22:56.716 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/130 2024-09-21T02:22:56.716 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:22:56.718 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:22:56.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:22:56.741 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-09-21T02:22:56.933 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:22:56.937 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:22:56.937 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:22:56.938 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:22:56.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:22:58.327 INFO:teuthology.orchestra.run.smithi040.stdout:generic/131 1s 2024-09-21T02:22:58.334 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/131 2024-09-21T02:22:58.334 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:22:58.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:22:58.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:22:58.407 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-09-21T02:22:58.826 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:22:58.830 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:22:58.831 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:22:58.832 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:22:58.832 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:23:00.176 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:23:00.181 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:23:11.138 INFO:teuthology.orchestra.run.smithi040.stdout:generic/132 13s 2024-09-21T02:23:11.144 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/132 2024-09-21T02:23:11.145 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:23:11.147 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:23:11.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:23:11.157 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-09-21T02:23:11.355 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:23:11.359 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:23:11.360 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:23:11.361 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:23:11.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:23:30.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:23:30.244 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:24:00.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:24:00.399 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:24:30.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:24:30.456 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:25:00.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:25:00.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:25:30.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:25:30.653 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:26:00.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:26:00.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:26:30.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:26:30.883 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:27:01.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:27:01.036 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:27:13.414 INFO:teuthology.orchestra.run.smithi040.stdout:generic/133 242s 2024-09-21T02:27:13.420 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/133 2024-09-21T02:27:13.420 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:13.423 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:13.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:13.468 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-09-21T02:27:13.902 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:13.906 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:13.906 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:13.907 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:13.907 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:14.177 INFO:teuthology.orchestra.run.smithi040.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:14.182 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/134 2024-09-21T02:27:14.182 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/134 2024-09-21T02:27:14.183 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:14.185 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:14.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:14.240 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-09-21T02:27:14.716 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:14.725 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:14.725 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:14.727 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:14.727 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:15.670 INFO:teuthology.orchestra.run.smithi040.stdout:generic/135 1s 2024-09-21T02:27:15.676 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/135 2024-09-21T02:27:15.677 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:15.679 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:15.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:15.689 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-09-21T02:27:15.893 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:15.897 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:15.898 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:15.899 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:15.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:16.173 INFO:teuthology.orchestra.run.smithi040.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-21T02:27:16.178 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/136 2024-09-21T02:27:16.178 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/136 2024-09-21T02:27:16.178 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:16.180 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:16.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:16.239 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-09-21T02:27:16.674 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:16.678 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:16.679 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:16.680 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:16.680 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:16.959 INFO:teuthology.orchestra.run.smithi040.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:16.964 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/137 2024-09-21T02:27:16.964 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/137 2024-09-21T02:27:16.964 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:17.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:17.029 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-09-21T02:27:17.467 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:17.471 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:17.471 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:17.472 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:17.473 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:17.748 INFO:teuthology.orchestra.run.smithi040.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:17.752 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/138 2024-09-21T02:27:17.753 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/138 2024-09-21T02:27:17.753 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:17.755 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:17.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:17.807 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-09-21T02:27:18.245 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:18.249 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:18.249 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:18.250 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:18.250 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:18.514 INFO:teuthology.orchestra.run.smithi040.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:18.519 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/139 2024-09-21T02:27:18.519 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/139 2024-09-21T02:27:18.519 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:18.521 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:18.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:18.583 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-09-21T02:27:18.995 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:18.999 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:18.999 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:19.000 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:19.000 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:19.277 INFO:teuthology.orchestra.run.smithi040.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:19.283 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/140 2024-09-21T02:27:19.283 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/140 2024-09-21T02:27:19.283 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:19.285 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:19.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:19.343 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-09-21T02:27:19.780 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:19.785 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:19.785 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:19.786 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:19.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:20.174 INFO:teuthology.orchestra.run.smithi040.stdout:generic/141 1s 2024-09-21T02:27:20.181 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/141 2024-09-21T02:27:20.181 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:20.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:20.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:20.192 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-09-21T02:27:20.396 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:20.400 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:20.401 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:20.402 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:20.402 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:20.670 INFO:teuthology.orchestra.run.smithi040.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:20.675 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/142 2024-09-21T02:27:20.675 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/142 2024-09-21T02:27:20.675 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:20.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:20.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:20.743 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-09-21T02:27:21.166 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:21.170 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:21.170 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:21.171 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:21.171 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:21.439 INFO:teuthology.orchestra.run.smithi040.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:21.444 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/143 2024-09-21T02:27:21.444 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/143 2024-09-21T02:27:21.444 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:21.446 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:21.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:21.511 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-09-21T02:27:21.943 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:21.947 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:21.947 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:21.948 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:21.949 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:22.214 INFO:teuthology.orchestra.run.smithi040.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:22.219 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/144 2024-09-21T02:27:22.220 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/144 2024-09-21T02:27:22.220 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:22.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:22.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:22.280 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-09-21T02:27:22.715 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:22.719 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:22.719 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:22.720 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:22.721 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:22.985 INFO:teuthology.orchestra.run.smithi040.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:22.989 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/145 2024-09-21T02:27:22.990 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/145 2024-09-21T02:27:22.990 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:22.992 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:23.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:23.061 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-09-21T02:27:23.486 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:23.490 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:23.490 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:23.491 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:23.492 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:23.756 INFO:teuthology.orchestra.run.smithi040.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:23.761 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/146 2024-09-21T02:27:23.761 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/146 2024-09-21T02:27:23.761 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:23.764 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:23.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:23.819 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-09-21T02:27:24.241 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:24.245 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:24.245 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:24.246 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:24.246 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:24.517 INFO:teuthology.orchestra.run.smithi040.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:24.522 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/147 2024-09-21T02:27:24.522 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/147 2024-09-21T02:27:24.522 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:24.524 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:24.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:24.579 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-09-21T02:27:25.003 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:25.007 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:25.008 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:25.009 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:25.009 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:25.274 INFO:teuthology.orchestra.run.smithi040.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:25.279 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/148 2024-09-21T02:27:25.279 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/148 2024-09-21T02:27:25.279 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:25.281 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:25.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:25.336 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-09-21T02:27:25.767 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:25.771 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:25.772 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:25.773 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:25.773 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:26.046 INFO:teuthology.orchestra.run.smithi040.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:26.051 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/149 2024-09-21T02:27:26.051 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/149 2024-09-21T02:27:26.051 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:26.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:26.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:26.097 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-09-21T02:27:26.558 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:26.562 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:26.562 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:26.563 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:26.564 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:26.831 INFO:teuthology.orchestra.run.smithi040.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:26.836 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/150 2024-09-21T02:27:26.836 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/150 2024-09-21T02:27:26.836 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:26.839 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:26.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:26.902 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-09-21T02:27:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:27.348 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:27.348 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:27.627 INFO:teuthology.orchestra.run.smithi040.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/151 2024-09-21T02:27:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/151 2024-09-21T02:27:27.632 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:27.635 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:27.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:27.702 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-09-21T02:27:28.121 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:28.126 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:28.126 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:28.395 INFO:teuthology.orchestra.run.smithi040.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/152 2024-09-21T02:27:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/152 2024-09-21T02:27:28.400 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:28.402 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:28.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:28.455 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-09-21T02:27:28.906 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:28.910 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:28.911 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:28.912 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:29.178 INFO:teuthology.orchestra.run.smithi040.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/153 2024-09-21T02:27:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/153 2024-09-21T02:27:29.183 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:29.186 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:29.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:29.250 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-09-21T02:27:29.673 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:29.677 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:29.678 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:29.679 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:29.938 INFO:teuthology.orchestra.run.smithi040.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/154 2024-09-21T02:27:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/154 2024-09-21T02:27:29.943 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:29.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:30.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:30.012 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-09-21T02:27:30.462 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:30.467 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:30.468 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:30.468 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:30.736 INFO:teuthology.orchestra.run.smithi040.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/155 2024-09-21T02:27:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/155 2024-09-21T02:27:30.741 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:30.743 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:30.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:30.805 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-09-21T02:27:31.225 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:31.229 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:31.230 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:31.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:31.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:27:31.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:27:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:31.509 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/156 2024-09-21T02:27:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/156 2024-09-21T02:27:31.510 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:31.512 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:31.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:31.576 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-09-21T02:27:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:32.024 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:32.025 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:32.299 INFO:teuthology.orchestra.run.smithi040.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:32.304 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/157 2024-09-21T02:27:32.304 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/157 2024-09-21T02:27:32.304 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:32.307 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:32.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:32.362 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-09-21T02:27:32.802 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:32.806 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:32.808 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:33.075 INFO:teuthology.orchestra.run.smithi040.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-21T02:27:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/158 2024-09-21T02:27:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/158 2024-09-21T02:27:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:33.083 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:33.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:33.146 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-09-21T02:27:33.584 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:33.587 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:33.589 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-09-21T02:27:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/159 2024-09-21T02:27:33.855 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/159 2024-09-21T02:27:33.856 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:33.858 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:33.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:33.877 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-09-21T02:27:34.077 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:34.081 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:34.081 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:34.082 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:34.082 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:34.344 INFO:teuthology.orchestra.run.smithi040.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-09-21T02:27:34.349 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/160 2024-09-21T02:27:34.349 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/160 2024-09-21T02:27:34.349 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:34.351 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:34.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:34.371 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-09-21T02:27:34.569 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:34.573 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:34.574 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:34.575 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:34.575 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:34.993 INFO:teuthology.orchestra.run.smithi040.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:35.000 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/161 2024-09-21T02:27:35.001 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/161 2024-09-21T02:27:35.001 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:35.003 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:35.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:35.278 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-09-21T02:27:35.492 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:35.496 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:35.497 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:35.498 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:35.498 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:35.860 INFO:teuthology.orchestra.run.smithi040.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-09-21T02:27:35.921 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/162 2024-09-21T02:27:35.921 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/162 2024-09-21T02:27:35.921 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:35.924 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:36.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:36.243 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-09-21T02:27:36.454 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:36.458 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:36.459 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:36.460 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:36.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:36.816 INFO:teuthology.orchestra.run.smithi040.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-09-21T02:27:36.874 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/163 2024-09-21T02:27:36.874 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/163 2024-09-21T02:27:36.874 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:36.878 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:37.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:37.215 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-09-21T02:27:37.412 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:37.416 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:37.416 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:37.418 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:37.418 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:37.843 INFO:teuthology.orchestra.run.smithi040.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:37.853 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/164 2024-09-21T02:27:37.853 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/164 2024-09-21T02:27:37.853 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:37.857 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:38.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:38.162 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-09-21T02:27:38.374 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:38.378 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:38.379 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:38.380 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:38.380 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:38.794 INFO:teuthology.orchestra.run.smithi040.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:38.801 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/165 2024-09-21T02:27:38.802 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/165 2024-09-21T02:27:38.802 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:38.805 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:39.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:39.119 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-09-21T02:27:39.320 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:39.324 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:39.325 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:39.326 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:39.326 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:39.762 INFO:teuthology.orchestra.run.smithi040.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:39.773 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/166 2024-09-21T02:27:39.773 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/166 2024-09-21T02:27:39.773 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:39.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:40.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:40.050 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-09-21T02:27:40.252 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:40.256 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:40.256 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:40.257 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:40.258 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:40.675 INFO:teuthology.orchestra.run.smithi040.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:40.691 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/167 2024-09-21T02:27:40.691 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/167 2024-09-21T02:27:40.691 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:40.694 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:40.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:40.957 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-09-21T02:27:41.169 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:41.173 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:41.174 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:41.175 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:41.175 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:41.605 INFO:teuthology.orchestra.run.smithi040.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:41.614 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/168 2024-09-21T02:27:41.614 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/168 2024-09-21T02:27:41.614 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:41.620 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:41.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:41.888 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-09-21T02:27:42.094 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:42.098 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:42.099 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:42.099 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:42.100 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:42.618 INFO:teuthology.orchestra.run.smithi040.stdout:generic/169 0s 2024-09-21T02:27:42.624 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/169 2024-09-21T02:27:42.625 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:42.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:42.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:42.636 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-09-21T02:27:42.835 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:42.839 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:42.840 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:42.841 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:42.841 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:43.296 INFO:teuthology.orchestra.run.smithi040.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:43.303 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/170 2024-09-21T02:27:43.304 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/170 2024-09-21T02:27:43.304 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:43.309 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:43.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:43.562 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-09-21T02:27:43.768 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:43.772 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:43.773 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:43.774 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:43.774 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:44.206 INFO:teuthology.orchestra.run.smithi040.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/171 2024-09-21T02:27:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/171 2024-09-21T02:27:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:44.220 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:44.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:44.557 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-09-21T02:27:44.765 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:44.770 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:44.770 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:44.771 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:44.771 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:45.188 INFO:teuthology.orchestra.run.smithi040.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:45.206 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/172 2024-09-21T02:27:45.206 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/172 2024-09-21T02:27:45.207 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:45.217 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:45.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:45.495 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-09-21T02:27:45.701 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:45.705 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:45.705 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:45.706 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:45.706 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:46.128 INFO:teuthology.orchestra.run.smithi040.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:46.139 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/173 2024-09-21T02:27:46.139 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/173 2024-09-21T02:27:46.139 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:46.143 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:46.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:46.441 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-09-21T02:27:46.642 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:46.646 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:46.647 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:46.648 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:46.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:47.076 INFO:teuthology.orchestra.run.smithi040.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:47.086 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/174 2024-09-21T02:27:47.086 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/174 2024-09-21T02:27:47.086 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:47.090 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:47.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:47.434 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-09-21T02:27:47.642 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:47.646 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:47.646 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:47.647 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:47.647 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:48.071 INFO:teuthology.orchestra.run.smithi040.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:48.080 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/175 2024-09-21T02:27:48.080 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/175 2024-09-21T02:27:48.080 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:48.082 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:48.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:48.400 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-09-21T02:27:48.603 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:48.607 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:48.608 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:48.609 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:48.609 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:49.042 INFO:teuthology.orchestra.run.smithi040.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:49.053 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/176 2024-09-21T02:27:49.053 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/176 2024-09-21T02:27:49.053 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:49.058 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:49.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:49.368 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-09-21T02:27:49.568 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:49.572 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:49.572 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:49.573 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:49.573 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:49.944 INFO:teuthology.orchestra.run.smithi040.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T02:27:49.950 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/177 2024-09-21T02:27:49.950 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/177 2024-09-21T02:27:49.950 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:49.952 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:50.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:50.005 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-09-21T02:27:50.439 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:50.443 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:50.443 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:50.444 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:50.444 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:50.726 INFO:teuthology.orchestra.run.smithi040.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:50.731 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/178 2024-09-21T02:27:50.731 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/178 2024-09-21T02:27:50.731 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:50.733 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:50.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:50.779 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-09-21T02:27:51.210 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:51.214 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:51.214 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:51.215 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:51.215 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:51.486 INFO:teuthology.orchestra.run.smithi040.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/179 2024-09-21T02:27:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/179 2024-09-21T02:27:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:51.494 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:51.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:51.558 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-09-21T02:27:52.000 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:52.004 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:52.005 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:52.006 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:52.006 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:52.269 INFO:teuthology.orchestra.run.smithi040.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:52.274 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/180 2024-09-21T02:27:52.274 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/180 2024-09-21T02:27:52.274 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:52.277 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:52.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:52.342 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-09-21T02:27:52.798 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:52.802 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:52.803 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:52.804 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:52.804 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:53.073 INFO:teuthology.orchestra.run.smithi040.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:27:53.078 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/181 2024-09-21T02:27:53.078 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/181 2024-09-21T02:27:53.078 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:53.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:53.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:53.145 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-09-21T02:27:53.583 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:53.587 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:53.587 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:53.588 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:53.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:53.860 INFO:teuthology.orchestra.run.smithi040.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-21T02:27:53.865 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/182 2024-09-21T02:27:53.865 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/182 2024-09-21T02:27:53.866 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:53.868 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:53.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:53.932 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-09-21T02:27:54.360 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:54.364 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:54.364 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:54.365 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:54.365 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:54.767 INFO:teuthology.orchestra.run.smithi040.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:54.779 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/183 2024-09-21T02:27:54.779 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/183 2024-09-21T02:27:54.779 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:54.785 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:55.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:55.082 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-09-21T02:27:55.288 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:55.292 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:55.293 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:55.294 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:55.294 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:55.575 INFO:teuthology.orchestra.run.smithi040.stdout:generic/184 0s 2024-09-21T02:27:55.581 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/184 2024-09-21T02:27:55.581 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:55.584 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:55.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:55.601 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-09-21T02:27:55.800 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:55.805 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:55.805 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:55.806 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:55.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:56.225 INFO:teuthology.orchestra.run.smithi040.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:56.236 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/185 2024-09-21T02:27:56.236 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/185 2024-09-21T02:27:56.236 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:56.242 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:56.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:56.518 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-09-21T02:27:56.735 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:56.739 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:56.739 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:56.740 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:56.740 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:57.160 INFO:teuthology.orchestra.run.smithi040.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:57.168 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/186 2024-09-21T02:27:57.169 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/186 2024-09-21T02:27:57.169 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:57.177 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:57.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:57.526 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-09-21T02:27:57.725 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:57.729 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:57.730 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:57.731 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:57.731 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:58.142 INFO:teuthology.orchestra.run.smithi040.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:58.161 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/187 2024-09-21T02:27:58.161 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/187 2024-09-21T02:27:58.161 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:58.170 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:58.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:58.426 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-09-21T02:27:58.658 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:58.662 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:58.662 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:58.664 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:58.664 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:59.074 INFO:teuthology.orchestra.run.smithi040.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:27:59.086 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/188 2024-09-21T02:27:59.086 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/188 2024-09-21T02:27:59.086 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:27:59.090 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:27:59.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:27:59.399 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-09-21T02:27:59.600 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:27:59.604 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:27:59.605 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:27:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:27:59.606 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:00.027 INFO:teuthology.orchestra.run.smithi040.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:00.036 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/189 2024-09-21T02:28:00.036 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/189 2024-09-21T02:28:00.036 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:00.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:00.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:00.315 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-09-21T02:28:00.542 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:00.546 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:00.546 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:00.548 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:00.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:00.960 INFO:teuthology.orchestra.run.smithi040.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:00.970 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/190 2024-09-21T02:28:00.970 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/190 2024-09-21T02:28:00.971 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:00.976 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:01.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:01.270 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-09-21T02:28:01.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:28:01.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:28:01.483 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:01.487 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:01.488 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:01.489 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:01.489 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:01.933 INFO:teuthology.orchestra.run.smithi040.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:01.944 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/191 2024-09-21T02:28:01.944 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/191 2024-09-21T02:28:01.944 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:01.948 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:02.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:02.231 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-09-21T02:28:02.466 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:02.470 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:02.470 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:02.471 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:02.472 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:02.725 INFO:teuthology.orchestra.run.smithi040.stdout:generic/192 [not run] atime not maintained by ceph 2024-09-21T02:28:02.730 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/192 2024-09-21T02:28:02.730 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/192 2024-09-21T02:28:02.730 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:02.732 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:02.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:02.746 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-09-21T02:28:02.942 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:02.946 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:02.947 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:02.947 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:02.948 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:03.879 INFO:teuthology.orchestra.run.smithi040.stdout:generic/193 0s 2024-09-21T02:28:03.886 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/193 2024-09-21T02:28:03.886 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:03.888 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:03.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:03.957 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-09-21T02:28:04.400 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:04.403 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:04.404 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:04.405 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:04.405 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:04.831 INFO:teuthology.orchestra.run.smithi040.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:04.839 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/194 2024-09-21T02:28:04.839 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/194 2024-09-21T02:28:04.839 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:04.844 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:05.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:05.175 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-09-21T02:28:05.377 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:05.381 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:05.381 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:05.382 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:05.382 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:05.785 INFO:teuthology.orchestra.run.smithi040.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:05.797 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/195 2024-09-21T02:28:05.797 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/195 2024-09-21T02:28:05.797 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:05.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:06.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:06.172 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-09-21T02:28:06.377 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:06.381 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:06.382 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:06.383 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:06.383 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:06.806 INFO:teuthology.orchestra.run.smithi040.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:06.813 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/196 2024-09-21T02:28:06.814 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/196 2024-09-21T02:28:06.814 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:06.821 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:07.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:07.167 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-09-21T02:28:07.369 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:07.373 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:07.374 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:07.375 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:07.375 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:07.807 INFO:teuthology.orchestra.run.smithi040.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:07.816 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/197 2024-09-21T02:28:07.816 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/197 2024-09-21T02:28:07.816 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:07.824 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:08.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:08.151 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-09-21T02:28:08.353 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:08.357 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:08.357 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:08.358 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:08.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:09.022 INFO:teuthology.orchestra.run.smithi040.stdout:generic/198 1s 2024-09-21T02:28:09.028 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/198 2024-09-21T02:28:09.029 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:09.031 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:09.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:09.075 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-09-21T02:28:09.560 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:09.566 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:09.566 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:09.567 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:09.567 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:09.986 INFO:teuthology.orchestra.run.smithi040.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:10.001 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/199 2024-09-21T02:28:10.002 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/199 2024-09-21T02:28:10.002 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:10.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:10.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:10.243 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-09-21T02:28:10.476 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:10.480 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:10.481 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:10.482 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:10.482 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:10.899 INFO:teuthology.orchestra.run.smithi040.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:10.913 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/200 2024-09-21T02:28:10.913 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/200 2024-09-21T02:28:10.913 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:10.915 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:11.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:11.204 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-09-21T02:28:11.412 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:11.416 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:11.416 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:11.418 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:11.418 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:11.838 INFO:teuthology.orchestra.run.smithi040.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:11.845 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/201 2024-09-21T02:28:11.845 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/201 2024-09-21T02:28:11.845 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:11.852 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:12.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:12.162 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-09-21T02:28:12.373 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:12.377 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:12.378 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:12.379 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:12.808 INFO:teuthology.orchestra.run.smithi040.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/202 2024-09-21T02:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/202 2024-09-21T02:28:12.816 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:12.823 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:13.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:13.025 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-09-21T02:28:13.297 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:13.301 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:13.301 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:13.303 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:13.708 INFO:teuthology.orchestra.run.smithi040.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/203 2024-09-21T02:28:13.717 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/203 2024-09-21T02:28:13.718 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:13.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:13.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:13.909 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-09-21T02:28:14.201 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:14.204 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:14.205 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:14.206 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:15.611 INFO:teuthology.orchestra.run.smithi040.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:28:15.616 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/204 2024-09-21T02:28:15.617 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/204 2024-09-21T02:28:15.617 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:15.619 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:15.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:15.650 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-09-21T02:28:15.845 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:15.849 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:15.850 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:15.851 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:15.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:16.259 INFO:teuthology.orchestra.run.smithi040.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:16.275 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/205 2024-09-21T02:28:16.275 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/205 2024-09-21T02:28:16.276 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:16.280 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:16.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:16.537 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-09-21T02:28:16.767 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:16.771 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:16.772 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:16.773 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:16.773 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:17.167 INFO:teuthology.orchestra.run.smithi040.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:28:17.177 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/206 2024-09-21T02:28:17.177 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/206 2024-09-21T02:28:17.178 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:17.185 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:17.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:17.395 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-09-21T02:28:17.654 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:17.658 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:17.658 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:17.659 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:17.659 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:25.171 INFO:teuthology.orchestra.run.smithi040.stdout:generic/207 8s 2024-09-21T02:28:25.178 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/207 2024-09-21T02:28:25.178 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:28:25.180 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:25.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:28:25.228 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-09-21T02:28:25.687 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:28:25.691 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:28:25.692 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:28:25.693 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:28:25.693 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:28:31.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:28:31.650 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:29:01.744 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:29:01.746 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:29:31.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:29:31.844 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:30:02.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:30:02.139 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:30:32.204 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:30:32.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:31:02.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:31:02.272 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:31:32.392 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:31:32.397 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:31:46.073 INFO:teuthology.orchestra.run.smithi040.stdout:generic/208 201s 2024-09-21T02:31:46.079 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/208 2024-09-21T02:31:46.079 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:31:46.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:31:46.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:31:46.128 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-09-21T02:31:46.570 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:31:46.574 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:31:46.574 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:31:46.575 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:31:46.576 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:02.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:32:02.484 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:32:19.524 INFO:teuthology.orchestra.run.smithi040.stdout:generic/209 33s 2024-09-21T02:32:19.530 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/209 2024-09-21T02:32:19.530 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:19.533 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:19.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:19.579 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-09-21T02:32:19.995 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:20.022 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:20.022 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:20.022 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:20.022 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:20.346 INFO:teuthology.orchestra.run.smithi040.stdout:generic/210 0s 2024-09-21T02:32:20.353 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/210 2024-09-21T02:32:20.353 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:20.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:20.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:20.404 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-09-21T02:32:20.874 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:20.878 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:20.879 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:20.880 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:20.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:generic/211 1s 2024-09-21T02:32:21.356 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/211 2024-09-21T02:32:21.356 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:21.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:21.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:21.374 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-09-21T02:32:21.573 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:21.577 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:21.577 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:21.578 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:21.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:21.898 INFO:teuthology.orchestra.run.smithi040.stdout:generic/212 0s 2024-09-21T02:32:21.904 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/212 2024-09-21T02:32:21.904 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:21.907 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:21.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:21.923 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-09-21T02:32:22.119 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:22.123 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:22.123 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:22.124 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:22.124 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:22.377 INFO:teuthology.orchestra.run.smithi040.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:32:22.382 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/213 2024-09-21T02:32:22.383 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/213 2024-09-21T02:32:22.383 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:22.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:22.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:22.398 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-09-21T02:32:22.594 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:22.598 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:22.599 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:22.600 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:22.600 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:22.853 INFO:teuthology.orchestra.run.smithi040.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:32:22.858 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/214 2024-09-21T02:32:22.858 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/214 2024-09-21T02:32:22.858 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:22.860 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:22.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:22.873 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-09-21T02:32:23.065 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:23.069 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:23.069 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:23.070 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:23.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:25.369 INFO:teuthology.orchestra.run.smithi040.stdout:generic/215 2s 2024-09-21T02:32:25.376 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/215 2024-09-21T02:32:25.376 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:25.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:25.414 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-09-21T02:32:25.612 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:25.616 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:25.617 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:25.618 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:25.618 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:26.011 INFO:teuthology.orchestra.run.smithi040.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:32:26.022 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/216 2024-09-21T02:32:26.022 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/216 2024-09-21T02:32:26.023 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:26.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:26.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:26.337 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-09-21T02:32:26.540 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:26.544 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:26.544 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:26.546 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:26.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:26.970 INFO:teuthology.orchestra.run.smithi040.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:32:26.982 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/217 2024-09-21T02:32:26.982 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/217 2024-09-21T02:32:26.982 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:26.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:27.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:27.318 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-09-21T02:32:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:27.524 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:27.524 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:27.940 INFO:teuthology.orchestra.run.smithi040.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:32:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/218 2024-09-21T02:32:27.950 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/218 2024-09-21T02:32:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:27.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:28.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:28.260 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-09-21T02:32:28.470 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:28.474 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:28.475 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:28.476 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:28.476 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:28.723 INFO:teuthology.orchestra.run.smithi040.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:32:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/219 2024-09-21T02:32:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/219 2024-09-21T02:32:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:28.730 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:28.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:28.743 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-09-21T02:32:28.939 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:28.943 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:28.944 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:29.380 INFO:teuthology.orchestra.run.smithi040.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:32:29.394 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/220 2024-09-21T02:32:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/220 2024-09-21T02:32:29.395 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:29.406 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:29.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:29.572 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-09-21T02:32:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:29.854 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:29.855 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:29.855 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:generic/221 2s 2024-09-21T02:32:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/221 2024-09-21T02:32:31.138 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:31.141 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:31.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:31.162 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-09-21T02:32:31.370 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:31.374 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:31.376 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:31.376 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:31.789 INFO:teuthology.orchestra.run.smithi040.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:32:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/222 2024-09-21T02:32:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/222 2024-09-21T02:32:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:31.807 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:32.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:32.030 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-09-21T02:32:32.281 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:32.285 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:32.286 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:32.287 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:32.287 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:32.541 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:32:32.541 INFO:teuthology.orchestra.run.smithi040.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:32:32.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:32:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/223 2024-09-21T02:32:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/223 2024-09-21T02:32:32.546 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:32.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:32.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:32.565 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-09-21T02:32:32.837 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:32.843 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:32.843 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:33.080 INFO:teuthology.orchestra.run.smithi040.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:32:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/224 2024-09-21T02:32:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/224 2024-09-21T02:32:33.085 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:33.087 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:33.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:33.100 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-09-21T02:32:33.298 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:33.302 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:33.303 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:33.304 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:33.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T02:32:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/225 2024-09-21T02:32:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/225 2024-09-21T02:32:33.591 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:33.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:33.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:33.648 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-09-21T02:32:34.092 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:34.096 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:34.096 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:34.097 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:34.098 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:34.369 INFO:teuthology.orchestra.run.smithi040.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:32:34.374 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/226 2024-09-21T02:32:34.374 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/226 2024-09-21T02:32:34.374 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:34.377 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:34.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:34.401 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-09-21T02:32:34.608 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:34.612 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:34.613 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:34.614 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:34.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:35.047 INFO:teuthology.orchestra.run.smithi040.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:32:35.055 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/227 2024-09-21T02:32:35.055 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/227 2024-09-21T02:32:35.055 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:35.066 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:35.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:35.301 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-09-21T02:32:35.530 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:35.534 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:35.534 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:35.535 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:35.536 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:35.799 INFO:teuthology.orchestra.run.smithi040.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:32:35.804 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/228 2024-09-21T02:32:35.804 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/228 2024-09-21T02:32:35.805 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:35.807 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:35.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:35.820 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-09-21T02:32:36.011 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:36.015 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:36.015 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:36.016 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:36.017 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:36.419 INFO:teuthology.orchestra.run.smithi040.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:32:36.428 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/229 2024-09-21T02:32:36.428 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/229 2024-09-21T02:32:36.428 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:36.436 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:36.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:36.757 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-09-21T02:32:36.959 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:36.963 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:36.963 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:36.964 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:36.964 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:37.201 INFO:teuthology.orchestra.run.smithi040.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:32:37.206 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/230 2024-09-21T02:32:37.206 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/230 2024-09-21T02:32:37.206 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:37.209 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:37.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:37.222 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-09-21T02:32:37.412 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:37.417 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:37.417 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:37.418 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:37.418 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:37.655 INFO:teuthology.orchestra.run.smithi040.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:32:37.661 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/231 2024-09-21T02:32:37.661 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/231 2024-09-21T02:32:37.661 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:37.663 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:37.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:37.676 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-09-21T02:32:37.866 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:37.870 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:37.871 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:37.872 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:37.872 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:38.105 INFO:teuthology.orchestra.run.smithi040.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:32:38.110 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/232 2024-09-21T02:32:38.110 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/232 2024-09-21T02:32:38.110 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:38.112 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:38.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:38.126 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-09-21T02:32:38.321 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:38.325 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:38.326 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:38.327 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:38.327 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:38.563 INFO:teuthology.orchestra.run.smithi040.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:32:38.568 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/233 2024-09-21T02:32:38.568 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/233 2024-09-21T02:32:38.568 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:38.571 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:38.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:38.585 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-09-21T02:32:38.787 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:38.791 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:38.791 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:38.793 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:38.793 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:39.024 INFO:teuthology.orchestra.run.smithi040.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:32:39.029 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/234 2024-09-21T02:32:39.029 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/234 2024-09-21T02:32:39.029 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:39.031 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:39.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:39.059 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-09-21T02:32:39.256 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:39.260 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:39.261 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:39.262 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:39.262 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:39.496 INFO:teuthology.orchestra.run.smithi040.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:32:39.502 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/235 2024-09-21T02:32:39.502 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/235 2024-09-21T02:32:39.502 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:39.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:39.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:39.532 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-09-21T02:32:39.729 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:39.733 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:39.734 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:39.734 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:39.735 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:41.034 INFO:teuthology.orchestra.run.smithi040.stdout:generic/236 2s 2024-09-21T02:32:41.041 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/236 2024-09-21T02:32:41.041 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:41.044 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:41.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:41.104 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-09-21T02:32:41.532 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:41.536 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:41.537 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:41.538 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:41.538 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:41.864 INFO:teuthology.orchestra.run.smithi040.stdout:generic/237 0s 2024-09-21T02:32:41.871 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/237 2024-09-21T02:32:41.871 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:41.873 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:41.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:41.960 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-09-21T02:32:42.375 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:42.379 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:42.379 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:42.380 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:42.380 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:42.798 INFO:teuthology.orchestra.run.smithi040.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:32:42.807 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/238 2024-09-21T02:32:42.807 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/238 2024-09-21T02:32:42.808 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:42.810 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:43.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:43.110 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-09-21T02:32:43.320 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:43.324 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:43.325 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:43.326 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:43.326 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:43.592 INFO:teuthology.orchestra.run.smithi040.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-09-21T02:32:43.597 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/239 2024-09-21T02:32:43.597 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/239 2024-09-21T02:32:43.597 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:43.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:43.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:43.622 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-09-21T02:32:43.821 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:43.825 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:43.825 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:43.826 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:43.827 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:44.078 INFO:teuthology.orchestra.run.smithi040.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-09-21T02:32:44.083 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/240 2024-09-21T02:32:44.083 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/240 2024-09-21T02:32:44.083 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:32:44.085 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:32:44.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:32:44.108 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-09-21T02:32:44.305 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:32:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:32:44.310 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:32:44.311 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:32:44.311 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:33:02.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:33:02.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:33:32.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:33:32.846 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:33:57.381 INFO:teuthology.orchestra.run.smithi040.stdout:generic/241 73s 2024-09-21T02:33:57.455 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/241 2024-09-21T02:33:57.455 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:33:57.457 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:33:58.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:33:58.483 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-09-21T02:33:58.922 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:33:58.926 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:33:58.926 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:33:58.927 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:33:58.927 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:33:59.797 INFO:teuthology.orchestra.run.smithi040.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:33:59.808 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/242 2024-09-21T02:33:59.808 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/242 2024-09-21T02:33:59.808 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:33:59.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:00.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:00.088 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-09-21T02:34:00.287 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:00.291 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:00.291 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:00.292 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:00.292 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:00.707 INFO:teuthology.orchestra.run.smithi040.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:34:00.715 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/243 2024-09-21T02:34:00.715 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/243 2024-09-21T02:34:00.715 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:00.719 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:01.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:01.042 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-09-21T02:34:01.247 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:01.252 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:01.253 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:01.496 INFO:teuthology.orchestra.run.smithi040.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:34:01.501 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/244 2024-09-21T02:34:01.502 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/244 2024-09-21T02:34:01.502 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:01.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:01.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:01.517 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-09-21T02:34:01.714 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:01.718 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:01.719 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:01.720 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:01.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:02.035 INFO:teuthology.orchestra.run.smithi040.stdout:generic/245 1s 2024-09-21T02:34:02.041 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/245 2024-09-21T02:34:02.041 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:02.044 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:02.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:02.095 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-09-21T02:34:02.535 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:02.539 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:02.540 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:02.541 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:02.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:02.814 INFO:teuthology.orchestra.run.smithi040.stdout:generic/246 0s 2024-09-21T02:34:02.821 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/246 2024-09-21T02:34:02.821 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:02.823 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:02.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:02.902 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-09-21T02:34:02.933 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:34:02.950 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:34:03.368 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:03.372 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:03.373 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:03.373 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:09.603 INFO:teuthology.orchestra.run.smithi040.stdout:generic/247 6s 2024-09-21T02:34:09.609 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/247 2024-09-21T02:34:09.610 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:09.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:09.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:09.621 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-09-21T02:34:09.818 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:09.822 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:09.823 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:09.824 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:09.824 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:10.105 INFO:teuthology.orchestra.run.smithi040.stdout:generic/248 1s 2024-09-21T02:34:10.111 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/248 2024-09-21T02:34:10.111 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:10.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:10.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:10.139 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-09-21T02:34:10.334 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:10.338 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:10.339 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:10.340 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:10.340 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:10.802 INFO:teuthology.orchestra.run.smithi040.stdout:generic/249 0s 2024-09-21T02:34:10.808 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/249 2024-09-21T02:34:10.808 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:10.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:10.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:10.865 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-09-21T02:34:11.340 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:11.344 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:11.345 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:11.346 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:11.346 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:11.590 INFO:teuthology.orchestra.run.smithi040.stdout:generic/250 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:34:11.595 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/250 2024-09-21T02:34:11.595 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/250 2024-09-21T02:34:11.595 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:11.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:11.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:11.611 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-09-21T02:34:11.803 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:11.806 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:11.807 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:11.808 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:11.808 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:12.153 INFO:teuthology.orchestra.run.smithi040.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:12.163 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/251 2024-09-21T02:34:12.163 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/251 2024-09-21T02:34:12.163 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:12.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:12.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:12.178 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-09-21T02:34:12.383 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:12.387 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:12.388 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:12.389 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:12.389 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:12.636 INFO:teuthology.orchestra.run.smithi040.stdout:generic/252 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:34:12.641 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/252 2024-09-21T02:34:12.641 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/252 2024-09-21T02:34:12.642 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:12.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:12.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:12.658 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-09-21T02:34:12.851 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:12.855 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:12.855 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:12.856 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:12.857 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:13.276 INFO:teuthology.orchestra.run.smithi040.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:34:13.288 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/253 2024-09-21T02:34:13.288 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/253 2024-09-21T02:34:13.288 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:13.291 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:13.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:13.626 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-09-21T02:34:13.828 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:13.832 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:13.832 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:13.834 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:13.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:14.243 INFO:teuthology.orchestra.run.smithi040.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:34:14.250 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/254 2024-09-21T02:34:14.250 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/254 2024-09-21T02:34:14.250 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:14.258 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:14.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:14.614 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-09-21T02:34:14.826 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:14.830 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:14.830 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:14.832 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:14.832 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:15.182 INFO:teuthology.orchestra.run.smithi040.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:34:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/255 2024-09-21T02:34:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/255 2024-09-21T02:34:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:15.188 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:15.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:15.256 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-09-21T02:34:15.718 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:15.722 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:15.723 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:15.724 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:15.724 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:16.224 INFO:teuthology.orchestra.run.smithi040.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:34:16.229 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/256 2024-09-21T02:34:16.229 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/256 2024-09-21T02:34:16.229 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:16.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:16.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:16.245 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-09-21T02:34:16.444 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:16.448 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:16.449 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:16.450 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:16.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:17.350 INFO:teuthology.orchestra.run.smithi040.stdout:generic/257 1s 2024-09-21T02:34:17.357 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/257 2024-09-21T02:34:17.357 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:17.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:17.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:17.430 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-09-21T02:34:17.871 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:17.875 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:17.875 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:17.876 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:17.877 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:18.233 INFO:teuthology.orchestra.run.smithi040.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-09-21T02:34:18.239 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/258 2024-09-21T02:34:18.239 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/258 2024-09-21T02:34:18.239 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:18.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:18.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:18.254 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-09-21T02:34:18.456 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:18.460 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:18.461 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:18.462 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:18.462 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:18.870 INFO:teuthology.orchestra.run.smithi040.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:34:18.884 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/259 2024-09-21T02:34:18.884 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/259 2024-09-21T02:34:18.884 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:18.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:19.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:19.225 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-09-21T02:34:19.421 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:19.425 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:19.426 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:19.427 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:19.427 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:19.757 INFO:teuthology.orchestra.run.smithi040.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:19.766 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/260 2024-09-21T02:34:19.767 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/260 2024-09-21T02:34:19.767 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:19.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:19.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:19.782 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-09-21T02:34:19.977 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:19.981 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:19.981 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:19.982 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:19.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:20.405 INFO:teuthology.orchestra.run.smithi040.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:34:20.417 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/261 2024-09-21T02:34:20.417 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/261 2024-09-21T02:34:20.418 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:20.421 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:20.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:20.740 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-09-21T02:34:20.948 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:20.952 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:20.953 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:20.954 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:20.954 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:21.369 INFO:teuthology.orchestra.run.smithi040.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:34:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/262 2024-09-21T02:34:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/262 2024-09-21T02:34:21.377 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:34:21.382 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:21.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:34:21.685 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-09-21T02:34:21.890 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:34:21.894 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:34:21.895 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:34:21.896 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:34:21.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:34:33.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:34:33.378 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:35:00.785 INFO:teuthology.orchestra.run.smithi040.stdout:generic/263 38s 2024-09-21T02:35:00.792 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/263 2024-09-21T02:35:00.792 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:00.794 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:00.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:00.851 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-09-21T02:35:01.294 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:01.298 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:01.298 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:01.299 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:01.299 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:01.695 INFO:teuthology.orchestra.run.smithi040.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:01.702 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/264 2024-09-21T02:35:01.702 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/264 2024-09-21T02:35:01.702 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:01.710 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:01.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:01.776 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-09-21T02:35:02.146 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:02.150 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:02.151 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:02.152 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:02.152 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:02.613 INFO:teuthology.orchestra.run.smithi040.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:02.621 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/265 2024-09-21T02:35:02.622 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/265 2024-09-21T02:35:02.622 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:02.635 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:02.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:02.687 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-09-21T02:35:03.053 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:03.057 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:03.058 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:03.059 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:03.059 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:03.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:35:03.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:35:03.487 INFO:teuthology.orchestra.run.smithi040.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:03.497 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/266 2024-09-21T02:35:03.497 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/266 2024-09-21T02:35:03.497 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:03.501 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:03.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:03.560 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-09-21T02:35:03.962 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:03.966 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:03.967 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:03.968 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:03.968 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:04.405 INFO:teuthology.orchestra.run.smithi040.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:04.421 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/267 2024-09-21T02:35:04.421 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/267 2024-09-21T02:35:04.421 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:04.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:04.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:04.518 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-09-21T02:35:04.867 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:04.871 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:04.871 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:04.872 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:04.872 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:05.296 INFO:teuthology.orchestra.run.smithi040.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/268 2024-09-21T02:35:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/268 2024-09-21T02:35:05.303 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:05.307 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:05.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:05.419 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-09-21T02:35:05.763 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:05.767 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:05.767 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:05.768 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:05.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:06.009 INFO:teuthology.orchestra.run.smithi040.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:35:06.014 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/269 2024-09-21T02:35:06.014 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/269 2024-09-21T02:35:06.014 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:06.016 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:06.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:06.045 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-09-21T02:35:06.240 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:06.244 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:06.245 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:06.246 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:06.246 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:06.476 INFO:teuthology.orchestra.run.smithi040.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:35:06.481 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/270 2024-09-21T02:35:06.481 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/270 2024-09-21T02:35:06.481 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:06.484 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:06.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:06.496 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-09-21T02:35:06.697 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:06.701 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:06.702 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:06.703 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:06.703 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:07.143 INFO:teuthology.orchestra.run.smithi040.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:07.151 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/271 2024-09-21T02:35:07.151 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/271 2024-09-21T02:35:07.151 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:07.158 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:07.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:07.235 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-09-21T02:35:07.578 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:07.582 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:07.582 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:07.583 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:07.583 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:08.020 INFO:teuthology.orchestra.run.smithi040.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:08.034 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/272 2024-09-21T02:35:08.035 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/272 2024-09-21T02:35:08.035 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:08.038 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:08.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:08.083 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-09-21T02:35:08.465 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:08.469 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:08.469 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:08.470 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:08.471 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:08.713 INFO:teuthology.orchestra.run.smithi040.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:35:08.718 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/273 2024-09-21T02:35:08.718 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/273 2024-09-21T02:35:08.718 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:08.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:08.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:08.733 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-09-21T02:35:08.927 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:08.931 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:08.932 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:08.933 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:08.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:09.183 INFO:teuthology.orchestra.run.smithi040.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-21T02:35:09.188 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/274 2024-09-21T02:35:09.188 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/274 2024-09-21T02:35:09.188 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:09.191 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:09.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:09.207 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-09-21T02:35:09.404 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:09.408 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:09.409 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:09.410 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:09.410 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:09.642 INFO:teuthology.orchestra.run.smithi040.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:35:09.647 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/275 2024-09-21T02:35:09.648 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/275 2024-09-21T02:35:09.648 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:09.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:09.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:09.672 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-09-21T02:35:09.878 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:09.882 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:09.883 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:09.884 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:09.884 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:10.345 INFO:teuthology.orchestra.run.smithi040.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:10.352 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/276 2024-09-21T02:35:10.352 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/276 2024-09-21T02:35:10.352 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:10.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:10.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:10.445 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-09-21T02:35:10.763 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:10.767 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:10.767 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:10.769 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:10.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:11.035 INFO:teuthology.orchestra.run.smithi040.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-09-21T02:35:11.040 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/277 2024-09-21T02:35:11.040 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/277 2024-09-21T02:35:11.040 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:11.042 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:11.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:11.080 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-09-21T02:35:11.273 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:11.277 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:11.278 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:11.279 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:11.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:11.710 INFO:teuthology.orchestra.run.smithi040.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:11.723 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/278 2024-09-21T02:35:11.723 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/278 2024-09-21T02:35:11.723 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:11.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:11.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:11.809 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-09-21T02:35:12.162 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:12.166 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:12.167 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:12.168 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:12.168 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:12.604 INFO:teuthology.orchestra.run.smithi040.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:12.616 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/279 2024-09-21T02:35:12.616 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/279 2024-09-21T02:35:12.617 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:12.620 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:12.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:12.684 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-09-21T02:35:13.035 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:13.039 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:13.039 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:13.040 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:13.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:13.329 INFO:teuthology.orchestra.run.smithi040.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:35:13.332 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/280 2024-09-21T02:35:13.332 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/280 2024-09-21T02:35:13.332 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:13.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:13.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:13.348 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-09-21T02:35:13.555 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:13.559 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:13.560 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:13.561 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:13.561 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:13.997 INFO:teuthology.orchestra.run.smithi040.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:14.008 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/281 2024-09-21T02:35:14.009 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/281 2024-09-21T02:35:14.009 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:14.016 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:14.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:14.075 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-09-21T02:35:14.441 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:14.445 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:14.445 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:14.446 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:14.446 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:14.880 INFO:teuthology.orchestra.run.smithi040.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:14.888 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/282 2024-09-21T02:35:14.888 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/282 2024-09-21T02:35:14.888 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:14.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:14.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:14.978 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-09-21T02:35:15.334 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:15.338 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:15.338 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:15.339 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:15.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:15.773 INFO:teuthology.orchestra.run.smithi040.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:15.781 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/283 2024-09-21T02:35:15.782 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/283 2024-09-21T02:35:15.782 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:15.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:15.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:15.913 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-09-21T02:35:16.220 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:16.224 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:16.225 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:16.226 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:16.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:16.634 INFO:teuthology.orchestra.run.smithi040.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:16.644 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/284 2024-09-21T02:35:16.644 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/284 2024-09-21T02:35:16.644 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:16.646 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:16.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:16.772 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-09-21T02:35:17.105 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:17.109 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:17.109 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:17.110 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:17.110 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:18.238 INFO:teuthology.orchestra.run.smithi040.stdout:generic/285 1s 2024-09-21T02:35:18.245 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/285 2024-09-21T02:35:18.245 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:18.247 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:18.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:18.607 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-09-21T02:35:19.121 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:19.127 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:19.128 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:19.129 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:19.129 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:19.466 INFO:teuthology.orchestra.run.smithi040.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:35:19.472 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/286 2024-09-21T02:35:19.472 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/286 2024-09-21T02:35:19.472 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:19.475 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:19.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:19.498 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-09-21T02:35:19.764 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:19.769 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:19.770 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:19.771 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:19.771 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:20.312 INFO:teuthology.orchestra.run.smithi040.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:20.322 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/287 2024-09-21T02:35:20.322 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/287 2024-09-21T02:35:20.322 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:20.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:20.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:20.391 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-09-21T02:35:20.794 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:20.799 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:20.799 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:20.801 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:20.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:21.230 INFO:teuthology.orchestra.run.smithi040.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/288 2024-09-21T02:35:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/288 2024-09-21T02:35:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:21.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:21.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:21.321 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-09-21T02:35:21.578 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:21.583 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:21.583 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:21.584 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:21.585 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:22.103 INFO:teuthology.orchestra.run.smithi040.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:22.110 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/289 2024-09-21T02:35:22.111 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/289 2024-09-21T02:35:22.111 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:22.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:22.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:22.180 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-09-21T02:35:22.598 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:22.604 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:22.604 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:22.606 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:22.606 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:23.157 INFO:teuthology.orchestra.run.smithi040.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:23.166 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/290 2024-09-21T02:35:23.166 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/290 2024-09-21T02:35:23.166 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:23.171 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:23.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:23.221 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-09-21T02:35:23.656 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:23.660 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:23.660 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:23.661 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:23.662 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:24.196 INFO:teuthology.orchestra.run.smithi040.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:24.205 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/291 2024-09-21T02:35:24.205 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/291 2024-09-21T02:35:24.205 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:24.207 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:24.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:24.256 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-09-21T02:35:24.693 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:24.699 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:24.700 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:24.702 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:24.702 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:25.195 INFO:teuthology.orchestra.run.smithi040.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:25.203 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/292 2024-09-21T02:35:25.203 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/292 2024-09-21T02:35:25.203 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:25.205 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:25.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:25.295 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-09-21T02:35:25.659 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:25.663 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:25.663 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:25.664 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:25.665 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:26.073 INFO:teuthology.orchestra.run.smithi040.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:26.086 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/293 2024-09-21T02:35:26.086 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/293 2024-09-21T02:35:26.086 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:26.101 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:26.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:26.199 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-09-21T02:35:26.559 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:26.563 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:26.563 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:26.564 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:26.564 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:27.090 INFO:teuthology.orchestra.run.smithi040.stdout:generic/294 1s 2024-09-21T02:35:27.103 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/294 2024-09-21T02:35:27.103 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:27.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:27.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:27.125 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-09-21T02:35:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:27.522 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:27.523 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:27.523 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:27.958 INFO:teuthology.orchestra.run.smithi040.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/295 2024-09-21T02:35:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/295 2024-09-21T02:35:27.972 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:27.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:28.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:28.041 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-09-21T02:35:28.423 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:28.428 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:28.429 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:28.823 INFO:teuthology.orchestra.run.smithi040.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/296 2024-09-21T02:35:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/296 2024-09-21T02:35:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:28.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:28.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:28.950 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-09-21T02:35:29.328 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:29.332 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:29.334 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:29.743 INFO:teuthology.orchestra.run.smithi040.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/297 2024-09-21T02:35:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/297 2024-09-21T02:35:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:29.766 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:29.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:29.848 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-09-21T02:35:30.220 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:30.224 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:30.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/298 2024-09-21T02:35:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/298 2024-09-21T02:35:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:30.654 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:30.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:30.808 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-09-21T02:35:31.122 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:31.126 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:31.127 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:31.128 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:31.434 INFO:teuthology.orchestra.run.smithi040.stdout:generic/299 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:35:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/299 2024-09-21T02:35:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/299 2024-09-21T02:35:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:31.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:31.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:31.459 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-09-21T02:35:31.651 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:31.655 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:31.656 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:generic/300 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:35:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/300 2024-09-21T02:35:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/300 2024-09-21T02:35:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:31.964 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:31.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:31.980 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-09-21T02:35:32.179 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:32.183 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:32.184 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:32.185 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:32.185 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:32.594 INFO:teuthology.orchestra.run.smithi040.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/301 2024-09-21T02:35:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/301 2024-09-21T02:35:32.604 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:32.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:32.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:32.659 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-09-21T02:35:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:33.056 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:33.480 INFO:teuthology.orchestra.run.smithi040.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/302 2024-09-21T02:35:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/302 2024-09-21T02:35:33.490 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:33.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:33.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:35:33.558 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:35:33.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:33.579 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-09-21T02:35:33.953 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:33.957 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:33.958 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:33.959 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:33.959 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:34.234 INFO:teuthology.orchestra.run.smithi040.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:35:34.239 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/303 2024-09-21T02:35:34.240 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/303 2024-09-21T02:35:34.240 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:34.242 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:34.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:34.311 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-09-21T02:35:34.733 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:34.737 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:34.738 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:34.739 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:34.739 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:35.016 INFO:teuthology.orchestra.run.smithi040.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-21T02:35:35.021 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/304 2024-09-21T02:35:35.021 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/304 2024-09-21T02:35:35.021 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:35.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:35.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:35.087 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-09-21T02:35:35.527 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:35.531 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:35.531 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:35.532 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:35.533 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:35.943 INFO:teuthology.orchestra.run.smithi040.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:35:35.954 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/305 2024-09-21T02:35:35.954 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/305 2024-09-21T02:35:35.955 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:35.967 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:36.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:36.049 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-09-21T02:35:36.416 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:36.420 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:36.420 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:36.421 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:36.421 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:37.013 INFO:teuthology.orchestra.run.smithi040.stdout:generic/306 0s 2024-09-21T02:35:37.023 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/306 2024-09-21T02:35:37.023 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:37.030 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:37.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:37.199 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-09-21T02:35:37.704 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:37.709 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:37.709 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:37.710 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:37.711 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:39.274 INFO:teuthology.orchestra.run.smithi040.stdout:generic/307 2s 2024-09-21T02:35:39.281 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/307 2024-09-21T02:35:39.281 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:39.284 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:39.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:39.293 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-09-21T02:35:39.490 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:39.494 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:39.494 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:39.496 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:39.496 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:39.767 INFO:teuthology.orchestra.run.smithi040.stdout:generic/308 0s 2024-09-21T02:35:39.774 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/308 2024-09-21T02:35:39.774 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:39.776 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:39.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:39.794 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-09-21T02:35:39.992 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:39.997 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:39.997 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:39.998 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:39.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:41.309 INFO:teuthology.orchestra.run.smithi040.stdout:generic/309 1s 2024-09-21T02:35:41.316 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/309 2024-09-21T02:35:41.316 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:35:41.319 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:35:41.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:35:41.366 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-09-21T02:35:41.809 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:35:41.813 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:35:41.813 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:35:41.814 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:35:41.814 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:36:03.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:36:03.733 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:36:34.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:36:34.218 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:36:58.903 INFO:teuthology.orchestra.run.smithi040.stdout:generic/310 77s 2024-09-21T02:36:58.972 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/310 2024-09-21T02:36:58.972 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:36:58.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:36:59.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:36:59.089 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-09-21T02:36:59.722 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:36:59.733 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:36:59.734 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:36:59.736 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:36:59.736 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:00.076 INFO:teuthology.orchestra.run.smithi040.stdout:generic/311 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:37:00.081 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/311 2024-09-21T02:37:00.081 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/311 2024-09-21T02:37:00.081 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:00.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:00.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:00.099 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-09-21T02:37:00.308 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:00.312 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:00.313 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:00.313 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:00.314 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:00.584 INFO:teuthology.orchestra.run.smithi040.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:37:00.590 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/312 2024-09-21T02:37:00.590 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/312 2024-09-21T02:37:00.590 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:00.592 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:00.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:00.607 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-09-21T02:37:00.809 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:00.813 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:00.814 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:00.815 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:00.815 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:04.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:37:04.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:37:05.127 INFO:teuthology.orchestra.run.smithi040.stdout:generic/313 5s 2024-09-21T02:37:05.135 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/313 2024-09-21T02:37:05.135 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:05.138 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:05.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:05.152 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-09-21T02:37:05.360 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:05.364 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:05.364 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:05.365 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:05.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:05.835 INFO:teuthology.orchestra.run.smithi040.stdout:generic/314 0s 2024-09-21T02:37:05.841 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/314 2024-09-21T02:37:05.841 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:05.844 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:05.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:05.860 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-09-21T02:37:06.063 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:06.067 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:06.067 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:06.068 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:06.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:06.336 INFO:teuthology.orchestra.run.smithi040.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-21T02:37:06.342 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/315 2024-09-21T02:37:06.342 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/315 2024-09-21T02:37:06.342 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:06.344 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:06.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:06.362 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-09-21T02:37:06.574 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:06.578 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:06.579 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:06.580 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:06.580 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:06.933 INFO:teuthology.orchestra.run.smithi040.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T02:37:06.939 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/316 2024-09-21T02:37:06.939 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/316 2024-09-21T02:37:06.939 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:06.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:07.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:07.017 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-09-21T02:37:07.448 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:07.452 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:07.452 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:07.453 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:07.453 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:08.284 INFO:teuthology.orchestra.run.smithi040.stdout:generic/317 1s 2024-09-21T02:37:08.291 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/317 2024-09-21T02:37:08.291 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:08.294 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:08.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:08.303 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-09-21T02:37:08.499 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:08.503 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:08.503 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:08.504 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:08.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:09.081 INFO:teuthology.orchestra.run.smithi040.stdout:generic/318 1s 2024-09-21T02:37:09.088 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/318 2024-09-21T02:37:09.088 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:09.090 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:09.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:09.099 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-09-21T02:37:09.307 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:09.311 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:09.312 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:09.313 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:09.313 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:09.690 INFO:teuthology.orchestra.run.smithi040.stdout:generic/319 0s 2024-09-21T02:37:09.697 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/319 2024-09-21T02:37:09.697 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:09.699 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:09.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:09.708 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-09-21T02:37:09.902 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:09.906 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:09.907 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:09.908 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:09.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:10.162 INFO:teuthology.orchestra.run.smithi040.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:37:10.168 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/320 2024-09-21T02:37:10.168 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/320 2024-09-21T02:37:10.168 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:10.171 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:10.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:10.185 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-09-21T02:37:10.387 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:10.391 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:10.392 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:10.393 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:10.393 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:10.640 INFO:teuthology.orchestra.run.smithi040.stdout:generic/321 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:37:10.645 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/321 2024-09-21T02:37:10.645 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/321 2024-09-21T02:37:10.645 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:10.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:10.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:10.660 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-09-21T02:37:10.860 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:10.864 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:10.864 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:10.865 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:10.865 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:11.120 INFO:teuthology.orchestra.run.smithi040.stdout:generic/322 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:37:11.125 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/322 2024-09-21T02:37:11.125 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/322 2024-09-21T02:37:11.125 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:37:11.128 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:11.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:37:11.140 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-09-21T02:37:11.336 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:37:11.340 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:37:11.341 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:37:11.342 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:37:11.342 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:37:34.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:37:34.342 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:38:04.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:38:04.700 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:38:34.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:38:34.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:38:35.060 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T02:38:35.060+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45731) UID: 0 2024-09-21T02:38:35.060 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T02:38:35.060+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45731) UID: 0 2024-09-21T02:38:35.061 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T02:38:35.060+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45731) UID: 0 2024-09-21T02:38:35.061 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T02:38:35.060+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45731) UID: 0 2024-09-21T02:39:12.107 INFO:teuthology.orchestra.run.smithi040.stdout:generic/323 121s 2024-09-21T02:39:12.113 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/323 2024-09-21T02:39:12.113 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:12.115 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:12.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:12.170 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-09-21T02:39:12.616 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:12.622 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:12.622 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:12.622 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:12.622 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:12.878 INFO:teuthology.orchestra.run.smithi040.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-09-21T02:39:12.883 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/324 2024-09-21T02:39:12.883 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/324 2024-09-21T02:39:12.883 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:12.885 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:12.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:12.897 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-09-21T02:39:13.102 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:13.106 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:13.107 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:13.108 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:13.108 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:13.350 INFO:teuthology.orchestra.run.smithi040.stdout:generic/325 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:39:13.355 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/325 2024-09-21T02:39:13.355 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/325 2024-09-21T02:39:13.355 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:13.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:13.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:13.369 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-09-21T02:39:13.573 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:13.576 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:13.577 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:13.578 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:13.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:13.997 INFO:teuthology.orchestra.run.smithi040.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:39:14.008 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/326 2024-09-21T02:39:14.008 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/326 2024-09-21T02:39:14.008 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:14.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:14.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:14.381 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-09-21T02:39:14.587 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:14.591 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:14.592 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:14.593 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:14.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:15.005 INFO:teuthology.orchestra.run.smithi040.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:39:15.013 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/327 2024-09-21T02:39:15.013 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/327 2024-09-21T02:39:15.013 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:15.022 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:15.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:15.394 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-09-21T02:39:15.596 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:15.600 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:15.601 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:15.602 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:15.602 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:16.031 INFO:teuthology.orchestra.run.smithi040.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:39:16.040 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/328 2024-09-21T02:39:16.040 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/328 2024-09-21T02:39:16.040 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:16.042 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:16.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:16.358 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-09-21T02:39:16.564 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:16.568 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:16.569 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:16.570 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:16.570 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:17.020 INFO:teuthology.orchestra.run.smithi040.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:39:17.030 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/329 2024-09-21T02:39:17.031 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/329 2024-09-21T02:39:17.031 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:17.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:17.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:17.373 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-09-21T02:39:17.573 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:17.577 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:17.578 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:17.579 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:17.579 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:17.989 INFO:teuthology.orchestra.run.smithi040.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:39:18.005 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/330 2024-09-21T02:39:18.005 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/330 2024-09-21T02:39:18.005 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:18.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:18.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:18.314 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-09-21T02:39:18.529 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:18.533 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:18.533 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:18.535 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:18.535 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:18.968 INFO:teuthology.orchestra.run.smithi040.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:39:18.979 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/331 2024-09-21T02:39:18.979 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/331 2024-09-21T02:39:18.980 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:18.986 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:19.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:19.253 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-09-21T02:39:19.462 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:19.466 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:19.467 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:19.468 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:19.468 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:19.883 INFO:teuthology.orchestra.run.smithi040.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:39:19.900 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/332 2024-09-21T02:39:19.900 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/332 2024-09-21T02:39:19.900 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:19.909 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:20.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:20.166 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-09-21T02:39:20.382 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:20.386 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:20.386 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:20.387 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:20.387 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:20.796 INFO:teuthology.orchestra.run.smithi040.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:39:20.809 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/333 2024-09-21T02:39:20.809 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/333 2024-09-21T02:39:20.809 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:20.813 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:21.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:21.144 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-09-21T02:39:21.355 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:21.360 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:21.361 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:21.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:21.765 INFO:teuthology.orchestra.run.smithi040.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:39:21.778 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/334 2024-09-21T02:39:21.778 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/334 2024-09-21T02:39:21.778 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:21.784 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:22.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:22.126 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-09-21T02:39:22.333 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:22.337 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:22.338 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:22.339 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:22.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:22.587 INFO:teuthology.orchestra.run.smithi040.stdout:generic/335 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:39:22.592 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/335 2024-09-21T02:39:22.592 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/335 2024-09-21T02:39:22.592 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:22.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:22.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:22.607 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-09-21T02:39:22.800 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:22.804 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:22.804 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:22.805 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:22.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:23.064 INFO:teuthology.orchestra.run.smithi040.stdout:generic/336 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:39:23.069 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/336 2024-09-21T02:39:23.069 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/336 2024-09-21T02:39:23.069 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:23.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:23.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:23.087 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-09-21T02:39:23.283 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:23.287 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:23.287 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:23.288 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:23.288 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:23.657 INFO:teuthology.orchestra.run.smithi040.stdout:generic/337 0s 2024-09-21T02:39:23.664 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/337 2024-09-21T02:39:23.664 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:23.667 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:23.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:23.675 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-09-21T02:39:23.874 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:23.878 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:23.879 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:23.880 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:23.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:24.124 INFO:teuthology.orchestra.run.smithi040.stdout:generic/338 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:39:24.129 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/338 2024-09-21T02:39:24.129 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/338 2024-09-21T02:39:24.129 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:39:24.132 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:39:24.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:39:24.159 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-09-21T02:39:24.367 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:39:24.371 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:39:24.372 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:39:24.373 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:39:24.373 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:19.787 INFO:teuthology.orchestra.run.smithi040.stdout:generic/339 55s 2024-09-21T02:40:19.793 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/339 2024-09-21T02:40:19.793 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:19.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:19.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:19.805 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-09-21T02:40:20.223 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:20.226 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:20.227 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:20.228 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:20.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:22.868 INFO:teuthology.orchestra.run.smithi040.stdout:generic/340 2s 2024-09-21T02:40:22.917 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/340 2024-09-21T02:40:22.917 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:22.930 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:22.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:22.944 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-09-21T02:40:23.437 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:23.442 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:23.442 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:23.444 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:23.444 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:23.789 INFO:teuthology.orchestra.run.smithi040.stdout:generic/341 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:40:23.794 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/341 2024-09-21T02:40:23.794 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/341 2024-09-21T02:40:23.795 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:23.797 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:23.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:23.811 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-09-21T02:40:24.009 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:24.013 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:24.014 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:24.014 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:24.015 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:24.256 INFO:teuthology.orchestra.run.smithi040.stdout:generic/342 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:40:24.261 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/342 2024-09-21T02:40:24.262 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/342 2024-09-21T02:40:24.262 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:24.264 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:24.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:24.276 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-09-21T02:40:24.475 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:24.479 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:24.480 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:24.481 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:24.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:24.746 INFO:teuthology.orchestra.run.smithi040.stdout:generic/343 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:40:24.751 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/343 2024-09-21T02:40:24.751 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/343 2024-09-21T02:40:24.751 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:24.754 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:24.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:24.770 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-09-21T02:40:24.976 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:24.980 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:24.980 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:24.981 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:24.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:29.691 INFO:teuthology.orchestra.run.smithi040.stdout:generic/344 4s 2024-09-21T02:40:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/344 2024-09-21T02:40:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:29.772 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:29.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:29.789 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-09-21T02:40:30.185 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:30.189 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:30.190 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:30.193 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:30.193 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:35.510 INFO:teuthology.orchestra.run.smithi040.stdout:generic/345 5s 2024-09-21T02:40:35.523 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/345 2024-09-21T02:40:35.524 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:35.528 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:35.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:35.545 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-09-21T02:40:36.034 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:36.039 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:36.040 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:36.041 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:36.041 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:38.740 INFO:teuthology.orchestra.run.smithi040.stdout:generic/346 2s 2024-09-21T02:40:38.752 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/346 2024-09-21T02:40:38.752 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:38.757 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:38.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:38.783 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-09-21T02:40:39.277 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:39.283 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:39.283 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:39.284 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:39.284 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:39.689 INFO:teuthology.orchestra.run.smithi040.stdout:generic/347 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:40:39.695 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/347 2024-09-21T02:40:39.695 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/347 2024-09-21T02:40:39.695 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:39.697 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:39.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:39.709 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-09-21T02:40:39.909 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:39.913 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:39.914 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:39.915 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:39.915 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:40.187 INFO:teuthology.orchestra.run.smithi040.stdout:generic/348 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:40:40.192 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/348 2024-09-21T02:40:40.192 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/348 2024-09-21T02:40:40.192 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:40.195 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:40.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:40.211 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-09-21T02:40:40.412 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:40.416 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:40.416 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:40.417 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:40.417 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:40.754 INFO:teuthology.orchestra.run.smithi040.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-21T02:40:40.759 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/349 2024-09-21T02:40:40.759 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/349 2024-09-21T02:40:40.759 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:40.762 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:40.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:40.779 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-09-21T02:40:40.995 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:40.999 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:41.000 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:41.001 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:41.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:41.663 INFO:teuthology.orchestra.run.smithi040.stdout:generic/350 0s 2024-09-21T02:40:41.670 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/350 2024-09-21T02:40:41.670 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:41.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:41.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:41.681 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-09-21T02:40:41.886 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:41.890 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:41.891 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:41.892 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:41.892 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:42.154 INFO:teuthology.orchestra.run.smithi040.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:40:42.159 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/351 2024-09-21T02:40:42.159 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/351 2024-09-21T02:40:42.159 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:42.161 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:42.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:42.177 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-09-21T02:40:42.380 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:42.384 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:42.384 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:42.385 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:42.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:42.823 INFO:teuthology.orchestra.run.smithi040.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:40:42.833 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/352 2024-09-21T02:40:42.833 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/352 2024-09-21T02:40:42.833 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:42.841 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:43.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:43.152 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-09-21T02:40:43.355 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:43.359 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:43.360 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:43.361 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:43.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:43.800 INFO:teuthology.orchestra.run.smithi040.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:40:43.809 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/353 2024-09-21T02:40:43.809 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/353 2024-09-21T02:40:43.810 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:43.813 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:44.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:44.156 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-09-21T02:40:44.360 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:44.365 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:44.366 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:44.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:46.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:40:46.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:40:46.543 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T02:40:46.542+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 316702) UID: 0 2024-09-21T02:40:46.543 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T02:40:46.542+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 316702) UID: 0 2024-09-21T02:40:48.765 INFO:teuthology.orchestra.run.smithi040.stdout:generic/354 4s 2024-09-21T02:40:48.787 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/354 2024-09-21T02:40:48.787 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:48.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:48.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:48.804 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-09-21T02:40:49.324 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:49.329 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:49.330 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:49.331 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:49.331 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:50.387 INFO:teuthology.orchestra.run.smithi040.stdout:generic/355 1s 2024-09-21T02:40:50.401 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/355 2024-09-21T02:40:50.401 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:50.404 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:50.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:50.469 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-09-21T02:40:51.093 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:51.098 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:51.099 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:51.100 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:51.100 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:51.720 INFO:teuthology.orchestra.run.smithi040.stdout:generic/356 [not run] swapfiles are not supported 2024-09-21T02:40:51.725 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/356 2024-09-21T02:40:51.726 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/356 2024-09-21T02:40:51.726 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:51.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:51.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:51.743 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-09-21T02:40:51.954 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:51.958 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:51.959 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:51.961 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:51.962 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:52.361 INFO:teuthology.orchestra.run.smithi040.stdout:generic/357 [not run] swapfiles are not supported 2024-09-21T02:40:52.366 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/357 2024-09-21T02:40:52.366 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/357 2024-09-21T02:40:52.366 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:52.369 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:52.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:52.383 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-09-21T02:40:52.583 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:52.587 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:52.587 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:52.588 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:52.589 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:53.039 INFO:teuthology.orchestra.run.smithi040.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:40:53.047 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/358 2024-09-21T02:40:53.048 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/358 2024-09-21T02:40:53.048 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:53.052 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:53.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:53.424 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-09-21T02:40:53.641 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:53.644 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:53.645 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:53.646 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:53.646 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:54.090 INFO:teuthology.orchestra.run.smithi040.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:40:54.099 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/359 2024-09-21T02:40:54.099 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/359 2024-09-21T02:40:54.099 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:54.104 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:54.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:54.320 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-09-21T02:40:54.653 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:54.657 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:54.657 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:54.658 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:54.658 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:54.945 INFO:teuthology.orchestra.run.smithi040.stdout:generic/360 0s 2024-09-21T02:40:54.952 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/360 2024-09-21T02:40:54.952 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:54.954 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:54.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:54.972 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-09-21T02:40:55.172 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:55.176 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:55.176 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:55.178 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:55.178 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:55.434 INFO:teuthology.orchestra.run.smithi040.stdout:generic/361 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:40:55.439 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/361 2024-09-21T02:40:55.439 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/361 2024-09-21T02:40:55.439 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:55.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:55.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:55.455 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-09-21T02:40:55.658 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:55.662 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:55.662 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:55.663 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:55.663 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:55.987 INFO:teuthology.orchestra.run.smithi040.stdout:generic/362 0s 2024-09-21T02:40:55.993 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/362 2024-09-21T02:40:55.993 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:55.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:56.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:56.049 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-09-21T02:40:56.551 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:56.556 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:56.556 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:56.558 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:56.558 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:56.819 INFO:teuthology.orchestra.run.smithi040.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:40:56.824 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/371 2024-09-21T02:40:56.824 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/371 2024-09-21T02:40:56.824 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:56.826 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:56.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:56.842 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-09-21T02:40:57.046 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:57.050 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:57.050 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:57.051 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:57.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:57.465 INFO:teuthology.orchestra.run.smithi040.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:40:57.472 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/372 2024-09-21T02:40:57.472 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/372 2024-09-21T02:40:57.473 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:57.484 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:57.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:57.894 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-09-21T02:40:58.102 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:58.106 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:58.106 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:58.107 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:58.108 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:58.528 INFO:teuthology.orchestra.run.smithi040.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:40:58.536 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/373 2024-09-21T02:40:58.536 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/373 2024-09-21T02:40:58.536 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:58.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:58.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:58.888 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-09-21T02:40:59.127 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:40:59.131 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:40:59.132 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:40:59.133 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:40:59.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:59.506 INFO:teuthology.orchestra.run.smithi040.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-09-21T02:40:59.556 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/374 2024-09-21T02:40:59.556 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/374 2024-09-21T02:40:59.556 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:40:59.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:40:59.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:40:59.859 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-09-21T02:41:00.167 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:00.171 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:00.171 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:00.172 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:00.172 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:00.493 INFO:teuthology.orchestra.run.smithi040.stdout:generic/375 0s 2024-09-21T02:41:00.500 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/375 2024-09-21T02:41:00.501 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:00.503 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:00.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:00.561 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-09-21T02:41:01.083 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:01.087 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:01.094 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:01.095 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:01.095 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:01.345 INFO:teuthology.orchestra.run.smithi040.stdout:generic/376 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:41:01.349 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/376 2024-09-21T02:41:01.366 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/376 2024-09-21T02:41:01.366 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:01.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:01.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:01.367 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-09-21T02:41:01.569 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:01.573 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:01.573 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:01.574 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:01.574 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:01.996 INFO:teuthology.orchestra.run.smithi040.stdout:generic/377 0s 2024-09-21T02:41:02.002 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/377 2024-09-21T02:41:02.002 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:02.005 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:02.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:02.014 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-09-21T02:41:02.218 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:02.222 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:02.222 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:02.223 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:02.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:02.705 INFO:teuthology.orchestra.run.smithi040.stdout:generic/378 0s 2024-09-21T02:41:02.711 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/378 2024-09-21T02:41:02.711 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:02.714 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:02.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:02.787 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-09-21T02:41:03.296 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:03.300 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:03.302 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:03.555 INFO:teuthology.orchestra.run.smithi040.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:41:03.560 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/379 2024-09-21T02:41:03.560 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/379 2024-09-21T02:41:03.560 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:03.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:03.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:03.575 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-09-21T02:41:03.776 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:03.780 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:03.781 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:03.782 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:03.782 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:04.032 INFO:teuthology.orchestra.run.smithi040.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:41:04.038 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/380 2024-09-21T02:41:04.038 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/380 2024-09-21T02:41:04.038 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:04.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:04.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:04.053 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-09-21T02:41:04.260 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:04.264 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:04.264 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:04.265 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:04.265 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:04.507 INFO:teuthology.orchestra.run.smithi040.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:41:04.512 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/381 2024-09-21T02:41:04.512 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/381 2024-09-21T02:41:04.512 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:04.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:04.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:04.527 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-09-21T02:41:04.723 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:04.727 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:04.727 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:04.728 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:04.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:04.973 INFO:teuthology.orchestra.run.smithi040.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:41:04.978 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/382 2024-09-21T02:41:04.978 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/382 2024-09-21T02:41:04.978 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:04.981 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:05.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:05.004 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-09-21T02:41:05.213 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:05.217 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:05.218 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:05.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:05.460 INFO:teuthology.orchestra.run.smithi040.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:41:05.465 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/383 2024-09-21T02:41:05.465 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/383 2024-09-21T02:41:05.465 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:05.467 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:05.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:05.481 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-09-21T02:41:05.676 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:05.680 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:05.681 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:05.682 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:05.682 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:05.937 INFO:teuthology.orchestra.run.smithi040.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:41:05.942 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/384 2024-09-21T02:41:05.942 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/384 2024-09-21T02:41:05.942 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:05.945 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:05.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:05.957 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-09-21T02:41:06.156 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:06.160 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:06.160 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:06.161 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:06.162 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:06.404 INFO:teuthology.orchestra.run.smithi040.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:41:06.409 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/385 2024-09-21T02:41:06.409 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/385 2024-09-21T02:41:06.409 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:06.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:06.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:06.441 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-09-21T02:41:06.639 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:06.643 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:06.643 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:06.644 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:06.645 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:06.879 INFO:teuthology.orchestra.run.smithi040.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:41:06.885 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/386 2024-09-21T02:41:06.885 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/386 2024-09-21T02:41:06.885 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:06.887 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:06.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:06.900 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-09-21T02:41:07.102 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:07.106 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:07.106 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:07.107 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:07.107 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:07.522 INFO:teuthology.orchestra.run.smithi040.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:41:07.529 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/387 2024-09-21T02:41:07.529 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/387 2024-09-21T02:41:07.529 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:07.536 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:07.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:07.912 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-09-21T02:41:08.124 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:08.128 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:08.128 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:08.129 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:08.129 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:08.393 INFO:teuthology.orchestra.run.smithi040.stdout:generic/388 [not run] require 172.21.15.40:6789:/scratch to be local device 2024-09-21T02:41:08.399 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/388 2024-09-21T02:41:08.399 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/388 2024-09-21T02:41:08.399 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:08.401 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:08.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:08.414 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-09-21T02:41:08.613 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:08.617 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:08.618 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:08.619 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:08.619 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:08.865 INFO:teuthology.orchestra.run.smithi040.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-09-21T02:41:08.870 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/389 2024-09-21T02:41:08.871 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/389 2024-09-21T02:41:08.871 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:08.873 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:08.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:08.890 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-09-21T02:41:09.096 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:09.100 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:09.100 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:09.101 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:09.101 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:09.376 INFO:teuthology.orchestra.run.smithi040.stdout:generic/390 [not run] ceph does not support freezing 2024-09-21T02:41:09.381 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/390 2024-09-21T02:41:09.381 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/390 2024-09-21T02:41:09.381 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:09.383 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:09.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:09.397 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-09-21T02:41:09.602 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:09.606 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:09.606 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:09.607 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:09.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:09.871 INFO:teuthology.orchestra.run.smithi040.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:41:09.876 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/391 2024-09-21T02:41:09.876 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/391 2024-09-21T02:41:09.876 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:09.878 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:09.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:09.894 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-09-21T02:41:10.104 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:10.108 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:10.108 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:10.109 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:10.110 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:10.453 INFO:teuthology.orchestra.run.smithi040.stdout:generic/392 [not run] ceph does not support shutdown 2024-09-21T02:41:10.462 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/392 2024-09-21T02:41:10.462 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/392 2024-09-21T02:41:10.462 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:10.464 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:10.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:10.477 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-09-21T02:41:10.678 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:10.682 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:10.682 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:10.683 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:10.683 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:11.444 INFO:teuthology.orchestra.run.smithi040.stdout:generic/393 1s 2024-09-21T02:41:11.451 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/393 2024-09-21T02:41:11.451 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:11.453 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:11.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:11.462 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-09-21T02:41:11.674 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:11.677 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:11.678 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:11.679 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:11.679 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:11.973 INFO:teuthology.orchestra.run.smithi040.stdout:generic/394 0s 2024-09-21T02:41:11.980 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/394 2024-09-21T02:41:11.980 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:11.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:12.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:12.063 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-09-21T02:41:12.556 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:12.560 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:12.560 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:12.561 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:12.561 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:13.028 INFO:teuthology.orchestra.run.smithi040.stdout:generic/395 [not run] kernel does not support ceph encryption 2024-09-21T02:41:13.047 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/395 2024-09-21T02:41:13.047 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/395 2024-09-21T02:41:13.047 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:13.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:13.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:13.077 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-09-21T02:41:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:13.383 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:13.383 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:13.385 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:13.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:13.973 INFO:teuthology.orchestra.run.smithi040.stdout:generic/396 [not run] kernel does not support ceph encryption 2024-09-21T02:41:13.994 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/396 2024-09-21T02:41:13.994 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/396 2024-09-21T02:41:13.994 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:13.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:14.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:14.021 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-09-21T02:41:14.323 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:14.327 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:14.327 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:14.328 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:14.328 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:14.736 INFO:teuthology.orchestra.run.smithi040.stdout:generic/397 [not run] kernel does not support ceph encryption 2024-09-21T02:41:14.755 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/397 2024-09-21T02:41:14.755 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/397 2024-09-21T02:41:14.755 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:14.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:14.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:14.771 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-09-21T02:41:14.982 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:14.986 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:14.987 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:14.988 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:14.988 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:15.387 INFO:teuthology.orchestra.run.smithi040.stdout:generic/398 [not run] kernel does not support ceph encryption 2024-09-21T02:41:15.407 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/398 2024-09-21T02:41:15.407 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/398 2024-09-21T02:41:15.407 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:15.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:15.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:15.422 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-09-21T02:41:15.634 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:15.638 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:15.638 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:15.639 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:15.639 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:16.046 INFO:teuthology.orchestra.run.smithi040.stdout:generic/399 [not run] kernel does not support ceph encryption 2024-09-21T02:41:16.055 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/399 2024-09-21T02:41:16.055 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/399 2024-09-21T02:41:16.055 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:16.057 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:16.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:16.070 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-09-21T02:41:16.285 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:16.289 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:16.289 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:16.290 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:16.291 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:16.533 INFO:teuthology.orchestra.run.smithi040.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T02:41:16.538 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/400 2024-09-21T02:41:16.539 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/400 2024-09-21T02:41:16.539 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:16.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:16.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:16.553 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-09-21T02:41:16.764 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:16.769 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:16.769 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:16.770 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:16.770 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:17.285 INFO:teuthology.orchestra.run.smithi040.stdout:generic/401 1s 2024-09-21T02:41:17.301 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/401 2024-09-21T02:41:17.301 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:17.308 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:17.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:17.321 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-09-21T02:41:17.802 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:17.806 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:17.806 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:17.807 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:17.807 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:18.199 INFO:teuthology.orchestra.run.smithi040.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-09-21T02:41:18.207 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/402 2024-09-21T02:41:18.208 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/402 2024-09-21T02:41:18.208 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:18.210 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:18.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:18.223 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-09-21T02:41:18.431 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:18.435 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:18.435 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:18.436 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:18.436 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:19.087 INFO:teuthology.orchestra.run.smithi040.stdout:generic/403 1s 2024-09-21T02:41:19.093 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/403 2024-09-21T02:41:19.093 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:19.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:19.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:19.105 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-09-21T02:41:19.307 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:19.311 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:19.311 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:19.312 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:19.313 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:19.570 INFO:teuthology.orchestra.run.smithi040.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:41:19.575 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/404 2024-09-21T02:41:19.575 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/404 2024-09-21T02:41:19.575 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:19.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:19.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:19.594 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-09-21T02:41:19.792 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:19.795 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:19.795 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:19.796 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:19.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:20.077 INFO:teuthology.orchestra.run.smithi040.stdout:generic/405 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:41:20.082 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/405 2024-09-21T02:41:20.082 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/405 2024-09-21T02:41:20.082 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:20.085 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:20.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:20.098 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-09-21T02:41:20.298 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:20.302 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:20.303 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:20.304 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:20.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:22.087 INFO:teuthology.orchestra.run.smithi040.stdout:generic/406 2s 2024-09-21T02:41:22.093 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/406 2024-09-21T02:41:22.093 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:22.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:22.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:22.105 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-09-21T02:41:22.313 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:22.317 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:22.317 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:22.318 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:22.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:22.606 INFO:teuthology.orchestra.run.smithi040.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:41:22.611 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/407 2024-09-21T02:41:22.611 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/407 2024-09-21T02:41:22.611 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:22.613 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:22.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:22.680 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-09-21T02:41:23.274 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:23.278 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:23.278 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:23.279 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:23.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:23.570 INFO:teuthology.orchestra.run.smithi040.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-21T02:41:23.575 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/408 2024-09-21T02:41:23.575 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/408 2024-09-21T02:41:23.575 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:23.577 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:23.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:23.640 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-09-21T02:41:24.172 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:24.176 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:24.176 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:24.177 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:24.177 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:24.447 INFO:teuthology.orchestra.run.smithi040.stdout:generic/409 [not run] require 172.21.15.40:6789:/scratch to be local device 2024-09-21T02:41:24.452 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/409 2024-09-21T02:41:24.453 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/409 2024-09-21T02:41:24.453 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:24.455 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:24.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:24.468 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-09-21T02:41:24.674 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:24.678 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:24.679 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:24.680 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:24.680 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:24.938 INFO:teuthology.orchestra.run.smithi040.stdout:generic/410 [not run] require 172.21.15.40:6789:/scratch to be local device 2024-09-21T02:41:24.943 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/410 2024-09-21T02:41:24.943 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/410 2024-09-21T02:41:24.943 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:24.945 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:24.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:24.967 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-09-21T02:41:25.168 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:25.172 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:25.172 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:25.174 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:25.174 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:25.495 INFO:teuthology.orchestra.run.smithi040.stdout:generic/411 [not run] require 172.21.15.40:6789:/scratch to be local device 2024-09-21T02:41:25.500 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/411 2024-09-21T02:41:25.500 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/411 2024-09-21T02:41:25.500 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:25.503 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:25.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:25.528 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-09-21T02:41:25.734 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:25.738 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:25.738 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:25.739 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:25.739 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:26.255 INFO:teuthology.orchestra.run.smithi040.stdout:generic/412 1s 2024-09-21T02:41:26.262 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/412 2024-09-21T02:41:26.262 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:26.265 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:26.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:26.274 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-09-21T02:41:26.479 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:26.483 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:26.483 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:26.485 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:26.485 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:26.832 INFO:teuthology.orchestra.run.smithi040.stdout:generic/413 [not run] mount 172.21.15.40:6789:/scratch with dax failed 2024-09-21T02:41:26.837 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/413 2024-09-21T02:41:26.837 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/413 2024-09-21T02:41:26.837 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:26.840 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:26.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:26.853 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-09-21T02:41:27.061 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:27.065 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:27.065 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:27.066 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:27.066 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:27.504 INFO:teuthology.orchestra.run.smithi040.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:41:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/414 2024-09-21T02:41:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/414 2024-09-21T02:41:27.525 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:27.533 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:27.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:27.913 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-09-21T02:41:28.125 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:28.129 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:28.131 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:28.583 INFO:teuthology.orchestra.run.smithi040.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:41:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/415 2024-09-21T02:41:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/415 2024-09-21T02:41:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:28.602 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:28.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:28.982 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-09-21T02:41:29.198 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:29.202 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:29.203 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:41:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/416 2024-09-21T02:41:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/416 2024-09-21T02:41:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:29.461 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:29.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:29.491 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-09-21T02:41:29.692 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:29.696 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:29.697 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:29.697 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:30.039 INFO:teuthology.orchestra.run.smithi040.stdout:generic/417 [not run] ceph does not support shutdown 2024-09-21T02:41:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/417 2024-09-21T02:41:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/417 2024-09-21T02:41:30.048 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:30.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:30.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:30.071 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-09-21T02:41:30.279 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:30.283 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:30.284 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:30.285 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:30.581 INFO:teuthology.orchestra.run.smithi040.stdout:generic/418 [not run] require 172.21.15.40:6789:/test to be valid block disk 2024-09-21T02:41:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/418 2024-09-21T02:41:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/418 2024-09-21T02:41:30.586 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:30.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:30.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:30.605 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-09-21T02:41:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:30.807 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:30.808 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:30.808 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:31.194 INFO:teuthology.orchestra.run.smithi040.stdout:generic/419 [not run] kernel does not support ceph encryption 2024-09-21T02:41:31.203 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/419 2024-09-21T02:41:31.203 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/419 2024-09-21T02:41:31.203 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:31.205 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:31.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:31.218 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-09-21T02:41:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:31.440 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:31.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:31.836 INFO:teuthology.orchestra.run.smithi040.stdout:generic/420 0s 2024-09-21T02:41:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/420 2024-09-21T02:41:31.842 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:31.845 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:31.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:31.904 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-09-21T02:41:32.425 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:32.430 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:32.430 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:generic/421 [not run] kernel does not support ceph encryption 2024-09-21T02:41:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/421 2024-09-21T02:41:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/421 2024-09-21T02:41:32.827 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:32.829 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:32.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:32.852 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-09-21T02:41:33.051 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:33.055 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:33.056 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:33.056 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:33.320 INFO:teuthology.orchestra.run.smithi040.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-21T02:41:33.325 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/422 2024-09-21T02:41:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/422 2024-09-21T02:41:33.326 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:33.328 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:33.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:33.344 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-09-21T02:41:33.544 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:33.549 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:33.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:generic/423 0s 2024-09-21T02:41:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/423 2024-09-21T02:41:33.896 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:33.898 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:33.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:33.968 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-09-21T02:41:34.494 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:34.498 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:34.498 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:34.499 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:34.500 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:34.774 INFO:teuthology.orchestra.run.smithi040.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-09-21T02:41:34.779 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/424 2024-09-21T02:41:34.779 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/424 2024-09-21T02:41:34.779 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:34.782 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:34.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:34.799 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-09-21T02:41:34.998 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:35.002 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:35.003 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:35.004 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:35.004 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:35.286 INFO:teuthology.orchestra.run.smithi040.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-09-21T02:41:35.291 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/425 2024-09-21T02:41:35.291 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/425 2024-09-21T02:41:35.292 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:41:35.294 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:41:35.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:41:35.353 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-09-21T02:41:35.876 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:41:35.880 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:41:35.881 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:41:35.881 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:41:35.881 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:13.712 INFO:teuthology.orchestra.run.smithi040.stdout:generic/426 37s 2024-09-21T02:42:13.857 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/426 2024-09-21T02:42:13.857 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:13.872 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:14.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:14.153 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-09-21T02:42:16.382 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:16.386 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:16.386 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:16.388 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:16.388 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:16.893 INFO:teuthology.orchestra.run.smithi040.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:42:16.898 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/427 2024-09-21T02:42:16.898 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/427 2024-09-21T02:42:16.899 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:16.902 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:16.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:16.920 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-09-21T02:42:17.122 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:17.126 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:17.126 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:17.127 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:17.127 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:17.481 INFO:teuthology.orchestra.run.smithi040.stdout:generic/428 0s 2024-09-21T02:42:17.487 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/428 2024-09-21T02:42:17.488 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:17.491 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:17.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:17.511 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-09-21T02:42:17.726 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:17.730 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:17.731 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:17.732 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:17.732 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:18.155 INFO:teuthology.orchestra.run.smithi040.stdout:generic/429 [not run] kernel does not support ceph encryption 2024-09-21T02:42:18.165 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/429 2024-09-21T02:42:18.165 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/429 2024-09-21T02:42:18.165 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:18.167 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:18.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:18.182 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-09-21T02:42:18.386 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:18.390 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:18.390 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:18.392 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:18.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:18.752 INFO:teuthology.orchestra.run.smithi040.stdout:generic/430 0s 2024-09-21T02:42:18.759 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/430 2024-09-21T02:42:18.759 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:18.762 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:18.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:18.860 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-09-21T02:42:19.351 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:19.355 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:19.355 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:19.357 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:19.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:19.694 INFO:teuthology.orchestra.run.smithi040.stdout:generic/431 0s 2024-09-21T02:42:19.700 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/431 2024-09-21T02:42:19.700 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:19.703 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:19.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:19.778 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-09-21T02:42:20.310 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:20.314 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:20.315 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:20.316 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:20.316 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:20.648 INFO:teuthology.orchestra.run.smithi040.stdout:generic/432 0s 2024-09-21T02:42:20.654 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/432 2024-09-21T02:42:20.654 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:20.657 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:20.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:20.722 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-09-21T02:42:21.248 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:21.252 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:21.252 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:21.253 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:21.254 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:21.575 INFO:teuthology.orchestra.run.smithi040.stdout:generic/433 0s 2024-09-21T02:42:21.581 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/433 2024-09-21T02:42:21.582 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:21.584 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:21.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:21.642 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-09-21T02:42:22.165 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:22.170 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:22.170 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:22.171 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:22.171 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:22.503 INFO:teuthology.orchestra.run.smithi040.stdout:generic/434 0s 2024-09-21T02:42:22.509 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/434 2024-09-21T02:42:22.510 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:22.512 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:22.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:22.588 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-09-21T02:42:23.095 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:23.099 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:23.099 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:23.100 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:23.100 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:23.481 INFO:teuthology.orchestra.run.smithi040.stdout:generic/435 [not run] kernel does not support ceph encryption 2024-09-21T02:42:23.491 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/435 2024-09-21T02:42:23.491 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/435 2024-09-21T02:42:23.491 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:23.493 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:23.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:23.507 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-09-21T02:42:23.699 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:23.703 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:23.703 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:23.704 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:23.704 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:24.310 INFO:teuthology.orchestra.run.smithi040.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:42:24.315 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/436 2024-09-21T02:42:24.315 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/436 2024-09-21T02:42:24.316 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:24.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:24.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:24.375 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-09-21T02:42:24.903 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:24.907 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:24.907 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:24.908 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:24.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:25.790 INFO:teuthology.orchestra.run.smithi040.stdout:generic/437 0s 2024-09-21T02:42:25.796 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/437 2024-09-21T02:42:25.797 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:42:25.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:42:25.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:42:25.820 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-09-21T02:42:26.017 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:42:26.021 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:42:26.021 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:42:26.022 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:42:26.022 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:52.630 INFO:teuthology.orchestra.run.smithi040.stdout:generic/438 86s 2024-09-21T02:43:52.637 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/438 2024-09-21T02:43:52.637 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:43:52.639 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:52.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:43:52.659 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-09-21T02:43:52.869 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:43:52.873 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:43:52.874 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:43:52.875 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:43:52.875 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:53.850 INFO:teuthology.orchestra.run.smithi040.stdout:generic/439 1s 2024-09-21T02:43:53.858 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/439 2024-09-21T02:43:53.858 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:43:53.861 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:53.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:43:53.876 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-09-21T02:43:54.070 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:43:54.074 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:43:54.074 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:43:54.075 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:43:54.076 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:54.476 INFO:teuthology.orchestra.run.smithi040.stdout:generic/440 [not run] kernel does not support ceph encryption 2024-09-21T02:43:54.486 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/440 2024-09-21T02:43:54.487 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/440 2024-09-21T02:43:54.487 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:43:54.489 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:54.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:43:54.503 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-09-21T02:43:54.702 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:43:54.706 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:43:54.706 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:43:54.707 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:43:54.707 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:55.591 INFO:teuthology.orchestra.run.smithi040.stdout:generic/441 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:43:55.597 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/441 2024-09-21T02:43:55.597 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/441 2024-09-21T02:43:55.597 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:43:55.600 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:55.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:43:55.616 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-09-21T02:43:55.821 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:43:55.825 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:43:55.826 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:43:55.827 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:43:55.827 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:56.199 INFO:teuthology.orchestra.run.smithi040.stdout:generic/442 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:43:56.204 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/442 2024-09-21T02:43:56.204 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/442 2024-09-21T02:43:56.204 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:43:56.207 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:56.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:43:56.221 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-09-21T02:43:56.418 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:43:56.422 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:43:56.423 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:43:56.424 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:43:56.424 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:56.757 INFO:teuthology.orchestra.run.smithi040.stdout:generic/443 0s 2024-09-21T02:43:56.763 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/443 2024-09-21T02:43:56.763 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:43:56.766 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:56.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:43:56.786 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-09-21T02:43:56.987 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:43:56.991 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:43:56.991 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:43:56.992 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:43:56.992 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:57.331 INFO:teuthology.orchestra.run.smithi040.stdout:generic/444 0s 2024-09-21T02:43:57.337 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/444 2024-09-21T02:43:57.337 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:43:57.340 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:57.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:43:57.361 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-09-21T02:43:57.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:43:57.476 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:43:57.565 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:43:57.569 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:43:57.570 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:43:57.571 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:43:57.571 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:58.166 INFO:teuthology.orchestra.run.smithi040.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:43:58.171 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/445 2024-09-21T02:43:58.171 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/445 2024-09-21T02:43:58.171 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:43:58.173 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:43:58.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:43:58.217 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-09-21T02:43:58.703 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:43:58.707 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:43:58.707 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:43:58.708 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:43:58.708 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:20.584 INFO:teuthology.orchestra.run.smithi040.stdout:generic/446 22s 2024-09-21T02:44:20.596 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/446 2024-09-21T02:44:20.596 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:20.604 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:20.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:20.621 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-09-21T02:44:21.070 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:21.074 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:21.074 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:21.075 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:21.075 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:21.508 INFO:teuthology.orchestra.run.smithi040.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:44:21.518 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/447 2024-09-21T02:44:21.518 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/447 2024-09-21T02:44:21.518 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:21.522 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:21.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:21.679 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-09-21T02:44:22.034 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:22.039 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:22.039 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:22.040 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:22.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:23.051 INFO:teuthology.orchestra.run.smithi040.stdout:generic/448 1s 2024-09-21T02:44:23.058 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/448 2024-09-21T02:44:23.058 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:23.060 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:23.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:23.125 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-09-21T02:44:23.590 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:23.594 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:23.594 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:23.595 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:23.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:23.887 INFO:teuthology.orchestra.run.smithi040.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T02:44:23.892 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/449 2024-09-21T02:44:23.892 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/449 2024-09-21T02:44:23.892 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:23.894 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:23.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:23.957 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-09-21T02:44:24.432 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:24.436 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:24.436 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:24.437 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:24.437 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:25.187 INFO:teuthology.orchestra.run.smithi040.stdout:generic/450 1s 2024-09-21T02:44:25.194 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/450 2024-09-21T02:44:25.194 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:25.196 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:25.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:25.261 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-09-21T02:44:25.707 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:25.711 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:25.712 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:25.713 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:25.713 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:27.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:44:27.565 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:44:56.081 INFO:teuthology.orchestra.run.smithi040.stdout:generic/451 31s 2024-09-21T02:44:56.087 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/451 2024-09-21T02:44:56.087 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:56.089 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:56.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:56.143 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-09-21T02:44:56.605 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:56.609 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:56.609 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:56.610 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:56.610 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:57.060 INFO:teuthology.orchestra.run.smithi040.stdout:generic/452 1s 2024-09-21T02:44:57.066 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/452 2024-09-21T02:44:57.066 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:57.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:57.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:57.077 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-09-21T02:44:57.276 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:57.280 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:57.280 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:57.281 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:57.281 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:57.523 INFO:teuthology.orchestra.run.smithi040.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-09-21T02:44:57.528 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/453 2024-09-21T02:44:57.528 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/453 2024-09-21T02:44:57.528 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:57.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:57.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:57.544 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-09-21T02:44:57.744 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:57.748 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:57.749 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:57.750 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:57.750 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:57.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:44:57.811 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:44:58.012 INFO:teuthology.orchestra.run.smithi040.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-09-21T02:44:58.017 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/454 2024-09-21T02:44:58.017 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/454 2024-09-21T02:44:58.017 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:58.019 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:58.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:58.041 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-09-21T02:44:58.247 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:58.251 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:58.251 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:58.252 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:58.252 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:58.564 INFO:teuthology.orchestra.run.smithi040.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-09-21T02:44:58.569 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/455 2024-09-21T02:44:58.570 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/455 2024-09-21T02:44:58.570 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:58.572 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:58.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:58.586 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-09-21T02:44:58.783 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:58.787 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:58.787 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:58.788 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:58.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:59.062 INFO:teuthology.orchestra.run.smithi040.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T02:44:59.067 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/456 2024-09-21T02:44:59.068 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/456 2024-09-21T02:44:59.068 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:59.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:59.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:59.089 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-09-21T02:44:59.298 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:44:59.302 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:44:59.302 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:44:59.303 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:44:59.303 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:59.824 INFO:teuthology.orchestra.run.smithi040.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:44:59.832 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/457 2024-09-21T02:44:59.832 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/457 2024-09-21T02:44:59.832 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:44:59.836 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:44:59.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:44:59.998 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-09-21T02:45:00.271 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:45:00.275 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:45:00.276 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:45:00.277 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:45:00.277 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:00.741 INFO:teuthology.orchestra.run.smithi040.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T02:45:00.752 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/458 2024-09-21T02:45:00.753 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/458 2024-09-21T02:45:00.753 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:45:00.762 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:00.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:45:00.962 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-09-21T02:45:01.271 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:45:01.276 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:45:01.276 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:45:01.276 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:45:01.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:01.761 INFO:teuthology.orchestra.run.smithi040.stdout:generic/459 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:45:01.766 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/459 2024-09-21T02:45:01.766 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/459 2024-09-21T02:45:01.766 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:45:01.768 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:01.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:45:01.783 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-09-21T02:45:01.976 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:45:01.979 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:45:01.980 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:45:01.981 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:45:01.981 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:03.872 INFO:teuthology.orchestra.run.smithi040.stdout:generic/460 1s 2024-09-21T02:45:03.878 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/460 2024-09-21T02:45:03.878 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:45:03.881 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:03.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:45:03.890 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-09-21T02:45:04.096 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:45:04.100 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:45:04.100 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:45:04.101 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:45:04.101 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:04.452 INFO:teuthology.orchestra.run.smithi040.stdout:generic/461 [not run] ceph does not support shutdown 2024-09-21T02:45:04.457 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/461 2024-09-21T02:45:04.457 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/461 2024-09-21T02:45:04.457 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:45:04.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:04.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:45:04.492 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-09-21T02:45:04.697 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:45:04.701 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:45:04.701 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:45:04.702 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:45:04.702 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:05.156 INFO:teuthology.orchestra.run.smithi040.stdout:generic/462 [not run] mount 172.21.15.40:6789:/scratch with dax failed 2024-09-21T02:45:05.161 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/462 2024-09-21T02:45:05.161 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/462 2024-09-21T02:45:05.161 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:45:05.164 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:05.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:45:05.191 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-09-21T02:45:05.386 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:45:05.390 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:45:05.390 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:45:05.391 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:45:05.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:05.675 INFO:teuthology.orchestra.run.smithi040.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T02:45:05.680 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/463 2024-09-21T02:45:05.680 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/463 2024-09-21T02:45:05.680 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:45:05.682 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:05.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:45:05.747 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-09-21T02:45:06.219 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:45:06.223 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:45:06.223 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:45:06.224 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:45:06.224 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:45:27.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:45:27.933 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:45:58.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:45:58.079 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:46:02.513 INFO:teuthology.orchestra.run.smithi040.stdout:generic/464 56s 2024-09-21T02:46:02.520 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/464 2024-09-21T02:46:02.520 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:46:02.523 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:02.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:46:02.532 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-09-21T02:46:02.733 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:46:02.737 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:46:02.737 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:46:02.738 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:46:02.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:06.964 INFO:teuthology.orchestra.run.smithi040.stdout:generic/465 3s 2024-09-21T02:46:06.980 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/465 2024-09-21T02:46:06.980 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:46:06.988 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:07.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:46:07.004 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-09-21T02:46:07.436 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:46:07.440 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:46:07.441 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:46:07.442 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:46:07.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:07.675 INFO:teuthology.orchestra.run.smithi040.stdout:generic/466 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:46:07.680 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/466 2024-09-21T02:46:07.680 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/466 2024-09-21T02:46:07.680 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:46:07.683 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:07.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:46:07.696 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-09-21T02:46:07.892 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:46:07.896 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:46:07.896 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:46:07.897 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:46:07.897 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:13.987 INFO:teuthology.orchestra.run.smithi040.stdout:generic/467 5s 2024-09-21T02:46:14.088 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/467 2024-09-21T02:46:14.088 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:46:14.090 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:14.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:46:14.319 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-09-21T02:46:15.378 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:46:15.382 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:46:15.382 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:46:15.383 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:46:15.383 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:15.809 INFO:teuthology.orchestra.run.smithi040.stdout:generic/468 [not run] ceph does not support shutdown 2024-09-21T02:46:15.818 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/468 2024-09-21T02:46:15.818 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/468 2024-09-21T02:46:15.818 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:46:15.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:15.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:46:15.833 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-09-21T02:46:16.036 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:46:16.040 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:46:16.040 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:46:16.041 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:46:16.041 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:16.305 INFO:teuthology.orchestra.run.smithi040.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-21T02:46:16.310 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/469 2024-09-21T02:46:16.310 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/469 2024-09-21T02:46:16.310 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:46:16.312 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:16.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:46:16.331 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-09-21T02:46:16.528 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:46:16.532 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:46:16.533 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:46:16.534 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:46:16.534 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:16.849 INFO:teuthology.orchestra.run.smithi040.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-09-21T02:46:16.854 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/470 2024-09-21T02:46:16.854 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/470 2024-09-21T02:46:16.854 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:46:16.857 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:16.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:46:16.871 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-09-21T02:46:17.079 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:46:17.083 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:46:17.084 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:46:17.085 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:46:17.085 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:46:28.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:46:28.176 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:46:58.313 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:46:58.316 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:47:07.053 INFO:teuthology.orchestra.run.smithi040.stdout:generic/471 50s 2024-09-21T02:47:07.076 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/471 2024-09-21T02:47:07.076 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:47:07.086 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:07.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:47:07.218 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-09-21T02:47:07.794 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:47:07.804 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:47:07.805 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:47:07.807 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:47:07.807 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:08.761 INFO:teuthology.orchestra.run.smithi040.stdout:generic/472 [not run] swapfiles are not supported 2024-09-21T02:47:08.766 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/472 2024-09-21T02:47:08.766 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/472 2024-09-21T02:47:08.766 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:47:08.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:08.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:47:08.787 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-09-21T02:47:08.984 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:47:08.988 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:47:08.988 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:47:08.990 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:47:08.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:09.280 INFO:teuthology.orchestra.run.smithi040.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T02:47:09.285 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/473 2024-09-21T02:47:09.285 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/473 2024-09-21T02:47:09.285 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:47:09.288 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:09.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:47:09.306 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-09-21T02:47:09.508 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:47:09.512 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:47:09.512 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:47:09.513 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:47:09.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:09.850 INFO:teuthology.orchestra.run.smithi040.stdout:generic/474 [not run] ceph does not support shutdown 2024-09-21T02:47:09.860 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/474 2024-09-21T02:47:09.860 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/474 2024-09-21T02:47:09.860 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:47:09.862 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:09.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:47:09.876 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-09-21T02:47:10.079 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:47:10.083 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:47:10.083 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:47:10.084 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:47:10.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:10.363 INFO:teuthology.orchestra.run.smithi040.stdout:generic/475 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T02:47:10.368 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/475 2024-09-21T02:47:10.368 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/475 2024-09-21T02:47:10.368 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T02:47:10.371 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:10.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T02:47:10.385 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-09-21T02:47:10.582 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T02:47:10.586 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T02:47:10.586 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T02:47:10.587 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T02:47:10.587 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T02:47:28.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:47:28.394 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:47:58.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:47:58.550 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:48:28.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:48:28.657 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:48:58.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:48:58.805 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:49:29.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:49:29.183 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:49:59.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:49:59.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:50:29.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:50:29.600 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:50:59.870 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:50:59.873 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:51:29.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:51:29.975 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:52:00.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:52:00.099 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:52:30.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:52:30.216 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:53:00.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:53:00.324 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:53:30.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:53:30.392 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:54:00.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:54:00.485 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:54:30.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:54:30.820 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:55:00.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:55:00.959 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:55:31.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:55:31.080 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:56:01.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:56:01.190 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:56:31.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:56:31.351 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T02:56:31.467 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T02:56:31.465+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 555772) UID: 0 2024-09-21T02:56:31.472 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T02:56:31.471+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 555772) UID: 0 2024-09-21T03:01:17.953 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T03:01:17.952+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555813) UID: 0 2024-09-21T03:01:17.955 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T03:01:17.953+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555813) UID: 0 2024-09-21T03:01:17.957 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T03:01:17.951+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555813) UID: 0 2024-09-21T03:01:17.959 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T03:01:17.957+0000 7fdab7f1b640 -1 Fail to open '/proc/555813/cmdline' error = (2) No such file or directory 2024-09-21T03:01:17.959 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T03:01:17.957+0000 7fdab7f1b640 -1 received signal: Hangup from (PID: 555813) UID: 0 2024-09-21T03:05:56.576 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:05:56.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:05:56.679 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T03:05:56.674+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48300) UID: 0 2024-09-21T03:05:56.680 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T03:05:56.677+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48300) UID: 0 2024-09-21T03:05:56.685 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T03:05:56.681+0000 7fb8d227c640 -1 Fail to open '/proc/48300/cmdline' error = (2) No such file or directory 2024-09-21T03:05:56.686 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T03:05:56.681+0000 7fb8d227c640 -1 received signal: Hangup from (PID: 48300) UID: 0 2024-09-21T03:05:56.686 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T03:05:56.677+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48300) UID: 0 2024-09-21T03:05:56.696 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T03:05:56.694+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555892) UID: 0 2024-09-21T03:05:56.696 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T03:05:56.694+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555892) UID: 0 2024-09-21T03:05:56.698 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T03:05:56.694+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555892) UID: 0 2024-09-21T03:05:56.698 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T03:05:56.692+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 555892) UID: 0 2024-09-21T03:11:56.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:11:56.934 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:11:57.101 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T03:11:57.099+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 555970) UID: 0 2024-09-21T03:11:57.101 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T03:11:57.099+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 555970) UID: 0 2024-09-21T03:17:34.378 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T03:17:34.376+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556046) UID: 0 2024-09-21T03:17:34.487 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T03:17:34.375+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556046) UID: 0 2024-09-21T03:17:34.487 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T03:17:34.376+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556046) UID: 0 2024-09-21T03:17:34.487 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T03:17:34.375+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556046) UID: 0 2024-09-21T03:22:15.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:15.196 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:15.226 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T03:22:15.225+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48531) UID: 0 2024-09-21T03:22:15.227 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T03:22:15.225+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48531) UID: 0 2024-09-21T03:22:15.227 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T03:22:15.225+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48531) UID: 0 2024-09-21T03:22:15.228 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T03:22:15.225+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48531) UID: 0 2024-09-21T03:25:36.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:36.288 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:36.396 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T03:25:36.394+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 556180) UID: 0 2024-09-21T03:25:36.397 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T03:25:36.395+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 556180) UID: 0 2024-09-21T03:31:33.100 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T03:31:33.098+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556280) UID: 0 2024-09-21T03:31:33.100 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T03:31:33.098+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556280) UID: 0 2024-09-21T03:31:33.101 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T03:31:33.098+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556280) UID: 0 2024-09-21T03:31:33.101 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T03:31:33.098+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556280) UID: 0 2024-09-21T03:36:04.684 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:36:04.702 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:36:04.740 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T03:36:04.738+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 556343) UID: 0 2024-09-21T03:36:04.740 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T03:36:04.738+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 556343) UID: 0 2024-09-21T03:36:04.741 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T03:36:04.738+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48675) UID: 0 2024-09-21T03:36:04.741 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T03:36:04.738+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48675) UID: 0 2024-09-21T03:36:04.741 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T03:36:04.738+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48675) UID: 0 2024-09-21T03:36:04.741 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T03:36:04.738+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48675) UID: 0 2024-09-21T03:41:01.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:41:01.522 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:41:31.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:41:31.676 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:42:01.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:42:01.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:42:31.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:42:31.853 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:42:31.893 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T03:42:31.890+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556511) UID: 0 2024-09-21T03:42:31.894 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T03:42:31.890+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556511) UID: 0 2024-09-21T03:42:31.894 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T03:42:31.890+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556511) UID: 0 2024-09-21T03:42:31.894 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T03:42:31.890+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556511) UID: 0 2024-09-21T03:47:01.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:47:01.635 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:47:01.704 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T03:47:01.702+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 556591) UID: 0 2024-09-21T03:47:01.705 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T03:47:01.702+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 556591) UID: 0 2024-09-21T03:52:25.376 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:52:25.379 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:52:55.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:52:55.518 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:53:25.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:53:25.951 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:53:25.992 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T03:53:25.988+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556722) UID: 0 2024-09-21T03:53:25.992 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T03:53:25.988+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556722) UID: 0 2024-09-21T03:53:25.993 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T03:53:25.988+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556722) UID: 0 2024-09-21T03:53:25.993 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T03:53:25.988+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556722) UID: 0 2024-09-21T03:57:53.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:57:53.384 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:57:53.445 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T03:57:53.443+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49086) UID: 0 2024-09-21T03:57:53.447 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T03:57:53.445+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49086) UID: 0 2024-09-21T03:57:53.448 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T03:57:53.445+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49086) UID: 0 2024-09-21T03:57:53.448 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T03:57:53.445+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49086) UID: 0 2024-09-21T03:57:53.459 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T03:57:53.455+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 556802) UID: 0 2024-09-21T03:57:53.459 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T03:57:53.456+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 556802) UID: 0 2024-09-21T04:03:38.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:03:38.565 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:04:08.685 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:04:08.688 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:04:38.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:04:38.816 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:05:08.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:05:08.898 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:05:38.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:05:38.997 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:05:42.961 INFO:teuthology.orchestra.run.smithi040.stdout:generic/476 4712s 2024-09-21T04:05:43.026 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/476 2024-09-21T04:05:43.027 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:05:43.030 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:05:43.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:05:43.049 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-09-21T04:05:53.002 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:05:53.005 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:05:53.006 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:05:53.007 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:05:53.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:06:09.144 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:06:09.147 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:06:39.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:06:39.279 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:06:39.324 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T04:06:39.322+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 557332) UID: 0 2024-09-21T04:06:39.325 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T04:06:39.322+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 557332) UID: 0 2024-09-21T04:11:26.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:11:26.674 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:11:26.705 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T04:11:26.703+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49372) UID: 0 2024-09-21T04:11:26.706 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T04:11:26.703+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49372) UID: 0 2024-09-21T04:11:26.706 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T04:11:26.703+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49372) UID: 0 2024-09-21T04:11:26.706 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T04:11:26.703+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49372) UID: 0 2024-09-21T04:11:26.721 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T04:11:26.719+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 557359) UID: 0 2024-09-21T04:11:26.722 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T04:11:26.719+0000 7f5dff06b640 -1 Fail to open '/proc/557359/cmdline' error = (2) No such file or directory 2024-09-21T04:11:26.722 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T04:11:26.719+0000 7f5dff06b640 -1 received signal: Hangup from (PID: 557359) UID: 0 2024-09-21T04:14:00.534 INFO:teuthology.orchestra.run.smithi040.stdout:generic/477 29s 2024-09-21T04:14:00.721 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/477 2024-09-21T04:14:00.721 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:00.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:00.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:00.968 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-09-21T04:14:03.639 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:03.646 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:03.646 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:03.647 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:03.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:generic/478 12s 2024-09-21T04:14:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/478 2024-09-21T04:14:15.180 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:15.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:15.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:15.234 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-09-21T04:14:15.564 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:15.575 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:15.577 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:15.578 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:15.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:16.150 INFO:teuthology.orchestra.run.smithi040.stdout:generic/479 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:16.158 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/479 2024-09-21T04:14:16.158 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/479 2024-09-21T04:14:16.158 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:16.162 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:16.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:16.201 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-09-21T04:14:16.517 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:16.523 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:16.524 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:16.525 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:16.525 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:16.946 INFO:teuthology.orchestra.run.smithi040.stdout:generic/480 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:16.953 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/480 2024-09-21T04:14:16.953 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/480 2024-09-21T04:14:16.953 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:16.956 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:17.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:17.010 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-09-21T04:14:17.354 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:17.359 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:17.360 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:17.362 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:17.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:17.759 INFO:teuthology.orchestra.run.smithi040.stdout:generic/481 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:17.767 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/481 2024-09-21T04:14:17.767 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/481 2024-09-21T04:14:17.767 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:17.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:17.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:17.788 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-09-21T04:14:18.086 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:18.091 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:18.091 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:18.092 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:18.093 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:18.551 INFO:teuthology.orchestra.run.smithi040.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2024-09-21T04:14:18.558 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/482 2024-09-21T04:14:18.558 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/482 2024-09-21T04:14:18.558 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:18.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:18.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:18.585 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-09-21T04:14:18.918 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:18.924 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:18.924 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:18.926 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:18.926 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:19.335 INFO:teuthology.orchestra.run.smithi040.stdout:generic/483 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:19.343 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/483 2024-09-21T04:14:19.343 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/483 2024-09-21T04:14:19.343 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:19.347 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:19.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:19.372 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-09-21T04:14:19.671 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:19.678 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:19.679 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:19.680 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:19.680 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:20.090 INFO:teuthology.orchestra.run.smithi040.stdout:generic/484 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:20.097 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/484 2024-09-21T04:14:20.097 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/484 2024-09-21T04:14:20.097 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:20.100 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:20.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:20.122 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-09-21T04:14:20.416 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:20.420 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:20.421 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:20.422 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:20.422 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:20.841 INFO:teuthology.orchestra.run.smithi040.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-21T04:14:20.848 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/485 2024-09-21T04:14:20.848 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/485 2024-09-21T04:14:20.848 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:20.852 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:20.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:20.890 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-09-21T04:14:21.211 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:21.217 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:21.219 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:21.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:22.079 INFO:teuthology.orchestra.run.smithi040.stdout:generic/486 0s 2024-09-21T04:14:22.161 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/486 2024-09-21T04:14:22.161 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:22.164 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:22.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:22.174 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-09-21T04:14:22.459 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:22.468 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:22.469 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:22.469 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:22.469 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:22.857 INFO:teuthology.orchestra.run.smithi040.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-09-21T04:14:22.861 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/487 2024-09-21T04:14:22.861 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/487 2024-09-21T04:14:22.861 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:22.865 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:22.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:22.886 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-09-21T04:14:23.145 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:23.151 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:23.152 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:23.152 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:23.153 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:23.601 INFO:teuthology.orchestra.run.smithi040.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T04:14:23.608 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/488 2024-09-21T04:14:23.608 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/488 2024-09-21T04:14:23.609 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:23.611 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:23.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:23.638 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-09-21T04:14:23.906 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:23.910 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:23.911 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:23.912 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:23.912 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:24.261 INFO:teuthology.orchestra.run.smithi040.stdout:generic/489 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:24.268 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/489 2024-09-21T04:14:24.269 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/489 2024-09-21T04:14:24.269 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:24.272 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:24.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:24.296 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-09-21T04:14:24.557 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:24.562 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:24.562 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:24.563 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:24.563 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:26.751 INFO:teuthology.orchestra.run.smithi040.stdout:generic/490 2s 2024-09-21T04:14:26.760 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/490 2024-09-21T04:14:26.760 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:26.763 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:26.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:26.848 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-09-21T04:14:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:27.469 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:27.470 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:27.471 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:27.471 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:27.922 INFO:teuthology.orchestra.run.smithi040.stdout:generic/491 [not run] ceph does not support freezing 2024-09-21T04:14:27.929 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/491 2024-09-21T04:14:27.929 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/491 2024-09-21T04:14:27.929 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:27.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:27.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:27.958 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-09-21T04:14:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:28.251 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:28.251 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:28.615 INFO:teuthology.orchestra.run.smithi040.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-09-21T04:14:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/492 2024-09-21T04:14:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/492 2024-09-21T04:14:28.621 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:28.624 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:28.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:28.650 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-09-21T04:14:28.955 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:28.961 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:28.962 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:28.963 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:28.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:generic/493 [not run] swapfiles are not supported 2024-09-21T04:14:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/493 2024-09-21T04:14:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/493 2024-09-21T04:14:29.601 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:29.603 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:29.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:29.632 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-09-21T04:14:29.908 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:29.913 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:29.914 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:29.914 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:30.472 INFO:teuthology.orchestra.run.smithi040.stdout:generic/494 [not run] swapfiles are not supported 2024-09-21T04:14:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/494 2024-09-21T04:14:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/494 2024-09-21T04:14:30.478 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:30.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:30.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:30.510 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-09-21T04:14:30.793 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:30.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:generic/495 [not run] swapfiles are not supported 2024-09-21T04:14:31.351 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/495 2024-09-21T04:14:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/495 2024-09-21T04:14:31.352 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:31.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:31.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:31.382 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-09-21T04:14:31.676 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:31.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:32.228 INFO:teuthology.orchestra.run.smithi040.stdout:generic/496 [not run] swapfiles are not supported 2024-09-21T04:14:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/496 2024-09-21T04:14:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/496 2024-09-21T04:14:32.547 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:32.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:32.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:32.548 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-09-21T04:14:32.812 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:32.818 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:32.819 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:32.820 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:32.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:33.385 INFO:teuthology.orchestra.run.smithi040.stdout:generic/497 [not run] swapfiles are not supported 2024-09-21T04:14:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/497 2024-09-21T04:14:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/497 2024-09-21T04:14:33.392 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:33.395 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:33.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:33.429 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-09-21T04:14:33.701 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:33.706 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:33.707 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:33.708 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:33.709 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:34.091 INFO:teuthology.orchestra.run.smithi040.stdout:generic/498 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:34.097 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/498 2024-09-21T04:14:34.097 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/498 2024-09-21T04:14:34.097 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:34.099 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:34.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:34.129 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-09-21T04:14:34.403 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:34.409 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:34.410 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:34.411 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:34.411 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:34.796 INFO:teuthology.orchestra.run.smithi040.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-21T04:14:34.802 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/499 2024-09-21T04:14:34.802 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/499 2024-09-21T04:14:34.802 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:34.805 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:34.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:34.835 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-09-21T04:14:35.121 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:35.129 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:35.130 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:35.507 INFO:teuthology.orchestra.run.smithi040.stdout:generic/500 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:35.514 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/500 2024-09-21T04:14:35.514 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/500 2024-09-21T04:14:35.514 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:35.517 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:35.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:35.538 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-09-21T04:14:35.831 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:35.837 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:35.838 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:35.840 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:35.840 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:36.471 INFO:teuthology.orchestra.run.smithi040.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T04:14:36.478 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/501 2024-09-21T04:14:36.478 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/501 2024-09-21T04:14:36.478 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:36.482 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:36.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:36.856 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-09-21T04:14:37.156 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:37.162 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:37.162 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:37.165 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:37.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:37.537 INFO:teuthology.orchestra.run.smithi040.stdout:generic/502 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:37.543 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/502 2024-09-21T04:14:37.543 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/502 2024-09-21T04:14:37.543 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:37.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:37.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:37.585 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-09-21T04:14:37.873 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:37.879 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:37.879 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:37.880 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:37.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:38.253 INFO:teuthology.orchestra.run.smithi040.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T04:14:38.261 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/503 2024-09-21T04:14:38.261 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/503 2024-09-21T04:14:38.261 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:38.265 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:38.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:38.298 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-09-21T04:14:38.568 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:38.573 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:38.574 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:38.575 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:38.575 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:38.976 INFO:teuthology.orchestra.run.smithi040.stdout:generic/504 0s 2024-09-21T04:14:38.988 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/504 2024-09-21T04:14:38.988 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:38.992 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:39.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:39.024 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-09-21T04:14:39.290 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:39.296 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:39.296 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:39.297 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:39.297 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:39.813 INFO:teuthology.orchestra.run.smithi040.stdout:generic/505 [not run] ceph does not support shutdown 2024-09-21T04:14:39.838 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/505 2024-09-21T04:14:39.838 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/505 2024-09-21T04:14:39.838 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:39.839 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:39.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:39.864 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-09-21T04:14:40.127 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:40.132 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:40.133 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:40.134 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:40.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:40.464 INFO:teuthology.orchestra.run.smithi040.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/506 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/506 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:40.474 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:40.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:40.492 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-09-21T04:14:40.768 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:40.776 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:40.777 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:40.779 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:40.779 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:41.162 INFO:teuthology.orchestra.run.smithi040.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-09-21T04:14:41.168 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/507 2024-09-21T04:14:41.169 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/507 2024-09-21T04:14:41.169 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:41.172 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:41.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:41.215 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-09-21T04:14:41.492 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:41.502 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:41.502 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:41.504 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:41.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:41.840 INFO:teuthology.orchestra.run.smithi040.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-09-21T04:14:41.847 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/508 2024-09-21T04:14:41.847 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/508 2024-09-21T04:14:41.847 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:41.850 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:41.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:41.874 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-09-21T04:14:42.157 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:42.164 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:42.164 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:42.166 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:42.166 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-09-21T04:14:42.532 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/509 2024-09-21T04:14:42.532 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/509 2024-09-21T04:14:42.532 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:42.534 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:42.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:42.555 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-09-21T04:14:42.834 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:42.839 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:42.840 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:42.841 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:42.841 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:43.192 INFO:teuthology.orchestra.run.smithi040.stdout:generic/510 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:43.202 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/510 2024-09-21T04:14:43.202 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/510 2024-09-21T04:14:43.202 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:43.207 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:43.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:43.233 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-09-21T04:14:43.523 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:43.528 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:43.529 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:43.530 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:43.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:43.871 INFO:teuthology.orchestra.run.smithi040.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-21T04:14:43.879 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/511 2024-09-21T04:14:43.879 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/511 2024-09-21T04:14:43.879 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:43.883 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:43.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:43.915 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-09-21T04:14:44.193 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:44.200 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:44.202 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:44.202 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:44.588 INFO:teuthology.orchestra.run.smithi040.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T04:14:44.596 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/512 2024-09-21T04:14:44.596 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/512 2024-09-21T04:14:44.596 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:44.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:44.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:44.636 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-09-21T04:14:44.919 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:44.925 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:44.925 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:44.926 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:44.926 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:45.507 INFO:teuthology.orchestra.run.smithi040.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T04:14:45.520 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/513 2024-09-21T04:14:45.520 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/513 2024-09-21T04:14:45.520 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:45.526 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:45.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:45.799 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-09-21T04:14:46.195 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:46.199 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:46.200 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:46.201 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:46.201 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:46.819 INFO:teuthology.orchestra.run.smithi040.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T04:14:46.828 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/514 2024-09-21T04:14:46.828 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/514 2024-09-21T04:14:46.828 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:46.831 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:47.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:47.140 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-09-21T04:14:47.486 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:47.490 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:47.491 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:47.492 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:47.492 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:48.114 INFO:teuthology.orchestra.run.smithi040.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T04:14:48.123 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/515 2024-09-21T04:14:48.123 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/515 2024-09-21T04:14:48.123 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:48.131 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:48.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:48.386 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-09-21T04:14:48.774 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:48.782 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:48.782 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:48.783 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:48.784 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:49.180 INFO:teuthology.orchestra.run.smithi040.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-09-21T04:14:49.186 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/516 2024-09-21T04:14:49.186 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/516 2024-09-21T04:14:49.186 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:49.189 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:49.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:49.242 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-09-21T04:14:49.757 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:49.763 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:49.764 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:49.765 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:49.765 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-09-21T04:14:50.346 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/517 2024-09-21T04:14:50.346 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/517 2024-09-21T04:14:50.346 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:50.353 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:50.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:50.676 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-09-21T04:14:51.006 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:51.012 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:51.012 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:51.014 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:51.014 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:51.600 INFO:teuthology.orchestra.run.smithi040.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T04:14:51.614 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/518 2024-09-21T04:14:51.614 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/518 2024-09-21T04:14:51.614 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:51.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:51.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:51.866 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-09-21T04:14:52.226 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:52.231 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:52.231 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:52.232 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:52.232 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:52.617 INFO:teuthology.orchestra.run.smithi040.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-09-21T04:14:52.623 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/519 2024-09-21T04:14:52.623 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/519 2024-09-21T04:14:52.623 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:52.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:52.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:52.702 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-09-21T04:14:53.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:14:53.046 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:14:53.241 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:53.247 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:53.247 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:53.248 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:53.249 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:53.608 INFO:teuthology.orchestra.run.smithi040.stdout:generic/520 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T04:14:53.614 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/520 2024-09-21T04:14:53.614 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/520 2024-09-21T04:14:53.614 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T04:14:53.617 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:14:53.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T04:14:53.636 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-09-21T04:14:53.907 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T04:14:53.912 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T04:14:53.913 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T04:14:53.914 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T04:14:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T04:15:23.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:15:23.203 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:15:53.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:15:53.268 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:16:23.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:16:23.652 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:16:53.968 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:16:53.971 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:17:24.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:17:24.380 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:17:54.441 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:17:54.444 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:18:24.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:18:24.519 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:18:54.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:18:54.597 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:19:24.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:19:24.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:19:54.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:19:54.755 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:20:24.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:20:24.835 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:20:54.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:20:54.908 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:21:25.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:21:25.279 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:21:55.350 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:21:55.353 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:22:25.441 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:22:25.445 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:22:55.548 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:22:55.550 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:23:25.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:23:25.673 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:23:55.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:23:55.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:24:25.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:24:25.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:24:56.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:24:56.020 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:25:26.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:25:26.088 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:25:56.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:25:56.422 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:26:26.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:26:26.727 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:26:26.778 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T04:26:26.774+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579211) UID: 0 2024-09-21T04:26:26.779 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T04:26:26.774+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579211) UID: 0 2024-09-21T04:26:26.779 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T04:26:26.777+0000 7f843b458640 -1 Fail to open '/proc/579211/cmdline' error = (2) No such file or directory 2024-09-21T04:26:26.779 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T04:26:26.777+0000 7f843b458640 -1 received signal: Hangup from (PID: 579211) UID: 0 2024-09-21T04:26:26.780 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T04:26:26.777+0000 7f7fecdd7640 -1 Fail to open '/proc/579211/cmdline' error = (2) No such file or directory 2024-09-21T04:26:26.780 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T04:26:26.777+0000 7f7fecdd7640 -1 received signal: Hangup from (PID: 579211) UID: 0 2024-09-21T04:29:50.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:29:50.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:29:50.816 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T04:29:50.813+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579234) UID: 0 2024-09-21T04:29:50.816 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T04:29:50.813+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579234) UID: 0 2024-09-21T04:29:50.817 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T04:29:50.813+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579234) UID: 0 2024-09-21T04:29:50.817 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T04:29:50.813+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579234) UID: 0 2024-09-21T04:33:16.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:33:16.023 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:33:16.064 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T04:33:16.061+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579260) UID: 0 2024-09-21T04:33:16.065 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T04:33:16.062+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579260) UID: 0 2024-09-21T04:33:16.065 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T04:33:16.062+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579260) UID: 0 2024-09-21T04:33:16.065 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T04:33:16.062+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579260) UID: 0 2024-09-21T04:36:41.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:36:41.689 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:37:11.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:37:11.761 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:37:41.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:37:41.852 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:38:12.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:38:12.053 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:38:42.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:38:42.160 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:39:12.319 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:39:12.324 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:39:42.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:39:42.395 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:40:12.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:40:12.498 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:40:42.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:40:42.930 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:41:12.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:41:12.999 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:41:43.077 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:41:43.080 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:42:13.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:42:13.153 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:42:43.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:42:43.503 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:43:13.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:43:13.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:43:44.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:43:44.131 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:43:44.167 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T04:43:44.164+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50138) UID: 0 2024-09-21T04:43:44.167 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T04:43:44.164+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50138) UID: 0 2024-09-21T04:43:44.168 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T04:43:44.165+0000 7f2a1ab13640 -1 received signal: Hangup from (PID: 50138) UID: 0 2024-09-21T04:43:44.168 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T04:43:44.164+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50138) UID: 0 2024-09-21T04:46:45.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:46:45.091 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:47:15.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:47:15.406 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:47:45.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:47:45.724 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:48:15.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:48:15.802 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:48:45.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:48:45.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:49:15.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:49:15.992 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:49:16.029 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T04:49:16.025+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50254) UID: 0 2024-09-21T04:49:16.029 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T04:49:16.025+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50254) UID: 0 2024-09-21T04:49:16.030 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T04:49:16.025+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50254) UID: 0 2024-09-21T04:49:16.034 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T04:49:16.025+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50254) UID: 0 2024-09-21T04:52:13.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:52:13.746 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:52:13.804 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T04:52:13.800+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 579677) UID: 0 2024-09-21T04:52:13.804 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T04:52:13.800+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 579677) UID: 0 2024-09-21T04:55:26.557 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T04:55:26.553+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579684) UID: 0 2024-09-21T04:55:26.558 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T04:55:26.553+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579684) UID: 0 2024-09-21T04:55:26.558 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T04:55:26.553+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579684) UID: 0 2024-09-21T04:55:26.562 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T04:55:26.553+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579684) UID: 0 2024-09-21T04:58:50.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:58:50.988 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T04:58:51.033 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T04:58:51.029+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50316) UID: 0 2024-09-21T04:58:51.034 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T04:58:51.030+0000 7fb8d227c640 -1 received signal: Hangup from (PID: 50316) UID: 0 2024-09-21T04:58:51.034 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T04:58:51.031+0000 7f2a1ab13640 -1 received signal: Hangup from (PID: 50316) UID: 0 2024-09-21T04:58:51.035 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T04:58:51.029+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50316) UID: 0 2024-09-21T05:02:05.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:02:05.143 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:02:35.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:02:35.219 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:03:05.332 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:03:05.335 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:03:05.372 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T05:03:05.368+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50389) UID: 0 2024-09-21T05:03:05.374 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T05:03:05.370+0000 7fc737969640 -1 Fail to open '/proc/50389/cmdline' error = (2) No such file or directory 2024-09-21T05:03:05.374 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T05:03:05.370+0000 7fc737969640 -1 received signal: Hangup from (PID: 50389) UID: 0 2024-09-21T05:03:05.374 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T05:03:05.370+0000 7f2a1ab13640 -1 Fail to open '/proc/50389/cmdline' error = (2) No such file or directory 2024-09-21T05:03:05.374 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T05:03:05.370+0000 7f2a1ab13640 -1 received signal: Hangup from (PID: 50389) UID: 0 2024-09-21T05:03:05.375 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T05:03:05.370+0000 7fb8d227c640 -1 Fail to open '/proc/50389/cmdline' error = (2) No such file or directory 2024-09-21T05:03:05.375 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T05:03:05.370+0000 7fb8d227c640 -1 received signal: Hangup from (PID: 50389) UID: 0 2024-09-21T05:03:05.382 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T05:03:05.379+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579777) UID: 0 2024-09-21T05:03:05.382 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T05:03:05.379+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579777) UID: 0 2024-09-21T05:03:05.382 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T05:03:05.379+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579777) UID: 0 2024-09-21T05:03:05.383 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T05:03:05.379+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579777) UID: 0 2024-09-21T05:05:39.737 INFO:teuthology.orchestra.run.smithi139.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2024-09-21T05:05:39.737 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: stdin: file size changed while zipping 2024-09-21T05:06:18.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:06:18.557 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:06:48.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:06:48.689 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:07:18.750 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:07:18.752 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:07:48.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:07:48.848 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:08:18.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:08:18.923 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:08:49.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:08:49.033 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:09:19.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:09:19.376 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:09:49.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:09:49.452 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:10:19.532 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:10:19.537 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:10:49.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:10:49.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:11:19.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:11:19.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:11:49.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:11:49.829 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:12:19.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:12:19.910 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:12:50.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:12:50.007 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:13:20.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:13:20.119 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:13:50.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:13:50.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:14:20.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:14:20.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:14:50.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:14:50.842 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:15:20.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:15:20.963 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:15:51.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:15:51.036 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:16:21.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:16:21.606 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:16:51.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:16:51.674 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:16:51.722 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T05:16:51.719+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580188) UID: 0 2024-09-21T05:16:51.722 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T05:16:51.720+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580188) UID: 0 2024-09-21T05:16:51.722 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T05:16:51.720+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580188) UID: 0 2024-09-21T05:16:51.723 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T05:16:51.720+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580188) UID: 0 2024-09-21T05:20:10.604 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:20:10.607 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:20:40.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:20:40.677 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:21:10.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:21:10.801 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:21:40.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:21:40.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:22:10.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:22:10.961 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:22:41.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:22:41.109 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:23:11.253 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:23:11.255 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:23:41.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:23:41.323 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:24:11.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:24:11.431 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:24:41.509 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:24:41.511 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:25:11.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:25:11.633 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:25:41.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:25:41.766 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:25:41.804 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T05:25:41.802+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51025) UID: 0 2024-09-21T05:25:41.804 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T05:25:41.803+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51025) UID: 0 2024-09-21T05:25:41.805 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T05:25:41.802+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51025) UID: 0 2024-09-21T05:25:41.805 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T05:25:41.803+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51025) UID: 0 2024-09-21T05:28:45.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:28:45.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:29:15.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:29:15.714 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:29:45.793 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:29:45.796 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:30:15.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:30:15.869 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:30:45.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:30:45.949 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:31:16.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:31:16.040 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:31:16.082 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T05:31:16.079+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580530) UID: 0 2024-09-21T05:31:16.083 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T05:31:16.079+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580530) UID: 0 2024-09-21T05:31:16.083 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T05:31:16.079+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580530) UID: 0 2024-09-21T05:31:16.083 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T05:31:16.079+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580530) UID: 0 2024-09-21T05:34:37.237 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:34:37.240 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:34:37.289 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T05:34:37.286+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580553) UID: 0 2024-09-21T05:34:37.289 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T05:34:37.286+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580553) UID: 0 2024-09-21T05:34:37.290 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T05:34:37.286+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580553) UID: 0 2024-09-21T05:34:37.290 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T05:34:37.287+0000 7f843b458640 -1 Fail to open '/proc/580553/cmdline' error = (2) No such file or directory 2024-09-21T05:34:37.290 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T05:34:37.287+0000 7f843b458640 -1 received signal: Hangup from (PID: 580553) UID: 0 2024-09-21T05:36:59.579 INFO:teuthology.orchestra.run.smithi040.stdout:generic/521 4925s 2024-09-21T05:36:59.597 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/521 2024-09-21T05:36:59.597 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T05:36:59.600 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T05:36:59.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T05:36:59.662 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-09-21T05:37:00.254 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T05:37:00.266 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T05:37:00.266 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T05:37:00.268 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T05:37:00.268 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T05:38:11.823 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:38:11.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:38:41.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:38:41.991 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:39:12.094 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:39:12.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:39:42.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:39:42.210 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:40:12.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:40:12.315 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:40:12.350 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T05:40:12.349+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51255) UID: 0 2024-09-21T05:40:12.350 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T05:40:12.349+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51255) UID: 0 2024-09-21T05:40:12.351 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T05:40:12.349+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51255) UID: 0 2024-09-21T05:40:12.351 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T05:40:12.349+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51255) UID: 0 2024-09-21T05:43:08.680 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:43:08.683 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:43:38.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:43:38.940 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:44:09.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:44:09.050 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:44:39.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:44:39.113 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:45:09.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:45:09.202 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:45:39.311 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:45:39.314 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:46:09.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:46:09.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:46:39.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:46:39.503 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:47:09.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:47:09.583 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:47:39.682 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:47:39.685 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:48:09.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:48:09.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:48:40.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:48:40.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:49:10.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:49:10.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:49:40.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:49:40.558 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:50:10.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:50:10.776 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:50:40.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:50:40.931 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:51:11.018 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:51:11.021 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:51:41.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:51:41.125 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:51:41.187 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T05:51:41.185+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 581466) UID: 0 2024-09-21T05:51:41.188 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T05:51:41.185+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 581466) UID: 0 2024-09-21T05:55:17.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:55:17.825 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:55:17.859 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T05:55:17.857+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51614) UID: 0 2024-09-21T05:55:17.860 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T05:55:17.857+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51614) UID: 0 2024-09-21T05:55:17.860 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T05:55:17.857+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51614) UID: 0 2024-09-21T05:55:17.860 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T05:55:17.857+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51614) UID: 0 2024-09-21T05:58:33.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:58:33.832 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:59:03.951 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:59:03.954 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:59:34.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T05:59:34.074 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:00:04.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:00:04.143 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:00:34.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:00:34.466 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:01:04.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:01:04.722 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:01:34.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:01:34.812 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:02:04.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:02:04.975 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:02:35.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:02:35.037 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:03:05.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:03:05.125 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:03:05.169 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T06:03:05.167+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581686) UID: 0 2024-09-21T06:03:05.169 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T06:03:05.167+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581686) UID: 0 2024-09-21T06:03:05.169 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T06:03:05.167+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581686) UID: 0 2024-09-21T06:03:05.172 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T06:03:05.167+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581686) UID: 0 2024-09-21T06:06:29.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:06:29.864 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:07:00.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:07:00.037 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:07:30.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:07:30.109 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:08:00.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:08:00.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:08:30.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:08:30.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:09:00.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:09:00.415 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:09:30.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:09:30.487 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:10:00.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:10:00.587 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:10:30.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:10:30.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:11:00.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:11:00.994 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:11:01.038 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T06:11:01.036+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581887) UID: 0 2024-09-21T06:11:01.038 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T06:11:01.036+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581887) UID: 0 2024-09-21T06:11:01.039 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T06:11:01.036+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581887) UID: 0 2024-09-21T06:11:01.039 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T06:11:01.036+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581887) UID: 0 2024-09-21T06:14:24.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:14:24.589 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:14:24.626 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T06:14:24.623+0000 7fc737969640 -1 Fail to open '/proc/52022/cmdline' error = (2) No such file or directory 2024-09-21T06:14:24.626 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T06:14:24.623+0000 7fc737969640 -1 received signal: Hangup from (PID: 52022) UID: 0 2024-09-21T06:14:24.626 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T06:14:24.624+0000 7f668efa1640 -1 Fail to open '/proc/52022/cmdline' error = (2) No such file or directory 2024-09-21T06:14:24.626 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T06:14:24.624+0000 7f668efa1640 -1 received signal: Hangup from (PID: 52022) UID: 0 2024-09-21T06:14:24.627 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T06:14:24.624+0000 7f2a1ab13640 -1 Fail to open '/proc/52022/cmdline' error = (2) No such file or directory 2024-09-21T06:14:24.627 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T06:14:24.624+0000 7f2a1ab13640 -1 received signal: Hangup from (PID: 52022) UID: 0 2024-09-21T06:14:24.627 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T06:14:24.624+0000 7fb8d227c640 -1 Fail to open '/proc/52022/cmdline' error = (2) No such file or directory 2024-09-21T06:14:24.627 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T06:14:24.624+0000 7fb8d227c640 -1 received signal: Hangup from (PID: 52022) UID: 0 2024-09-21T06:17:31.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:17:31.994 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:18:02.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:18:02.062 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:18:32.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:18:32.161 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:19:02.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:19:02.233 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:19:02.272 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T06:19:02.270+0000 7fb8d227c640 -1 received signal: Hangup from (PID: 52100) UID: 0 2024-09-21T06:19:02.272 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T06:19:02.271+0000 7f668efa1640 -1 received signal: Hangup from (PID: 52100) UID: 0 2024-09-21T06:19:02.272 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T06:19:02.270+0000 7fc737969640 -1 received signal: Hangup from (PID: 52100) UID: 0 2024-09-21T06:19:02.272 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T06:19:02.271+0000 7f2a1ab13640 -1 received signal: Hangup from (PID: 52100) UID: 0 2024-09-21T06:22:06.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:22:06.119 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:22:06.169 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T06:22:06.167+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582008) UID: 0 2024-09-21T06:22:06.169 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T06:22:06.167+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582008) UID: 0 2024-09-21T06:22:06.169 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T06:22:06.167+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582008) UID: 0 2024-09-21T06:22:06.170 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T06:22:06.167+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582008) UID: 0 2024-09-21T06:28:42.922 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:28:42.928 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:29:13.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:29:13.703 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:29:43.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:29:43.777 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:30:13.864 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:30:13.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:30:44.253 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:30:44.256 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:31:14.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:31:14.331 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:31:14.377 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T06:31:14.375+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52239) UID: 0 2024-09-21T06:31:14.378 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T06:31:14.375+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52239) UID: 0 2024-09-21T06:31:14.378 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T06:31:14.375+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52239) UID: 0 2024-09-21T06:31:14.378 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T06:31:14.375+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52239) UID: 0 2024-09-21T06:32:36.705 INFO:teuthology.orchestra.run.smithi040.stdout:generic/522 3336s 2024-09-21T06:32:36.723 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/522 2024-09-21T06:32:36.723 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:36.726 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:36.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:36.763 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-09-21T06:32:37.060 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:37.065 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:37.070 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:37.071 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:37.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:37.730 INFO:teuthology.orchestra.run.smithi040.stdout:generic/523 0s 2024-09-21T06:32:37.739 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/523 2024-09-21T06:32:37.739 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:37.743 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:37.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:37.753 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-09-21T06:32:38.021 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:38.025 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:38.026 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:38.027 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:38.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:42.583 INFO:teuthology.orchestra.run.smithi040.stdout:generic/524 4s 2024-09-21T06:32:42.592 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/524 2024-09-21T06:32:42.592 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:42.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:42.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:42.607 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-09-21T06:32:42.878 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:42.883 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:42.884 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:42.885 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:42.885 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:43.392 INFO:teuthology.orchestra.run.smithi040.stdout:generic/525 [not run] filesystem does not support huge file size 2024-09-21T06:32:43.409 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/525 2024-09-21T06:32:43.410 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/525 2024-09-21T06:32:43.410 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:43.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:43.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:43.437 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-09-21T06:32:43.703 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:43.707 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:43.708 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:43.709 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:43.709 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:44.153 INFO:teuthology.orchestra.run.smithi040.stdout:generic/526 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:32:44.160 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/526 2024-09-21T06:32:44.160 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/526 2024-09-21T06:32:44.160 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:44.163 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:44.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:44.197 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-09-21T06:32:44.467 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:44.472 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:44.472 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:44.474 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:44.474 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:44.836 INFO:teuthology.orchestra.run.smithi040.stdout:generic/527 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:32:44.843 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/527 2024-09-21T06:32:44.843 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/527 2024-09-21T06:32:44.843 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:44.845 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:44.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:44.882 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-09-21T06:32:45.144 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:45.150 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:45.151 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:45.152 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:45.152 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:45.575 INFO:teuthology.orchestra.run.smithi040.stdout:generic/528 0s 2024-09-21T06:32:45.584 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/528 2024-09-21T06:32:45.585 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:45.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:45.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:45.634 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-09-21T06:32:46.213 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:46.219 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:46.220 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:46.221 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:46.221 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:46.870 INFO:teuthology.orchestra.run.smithi040.stdout:generic/529 0s 2024-09-21T06:32:46.878 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/529 2024-09-21T06:32:46.878 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:46.882 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:46.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:46.893 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-09-21T06:32:47.183 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:47.187 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:47.188 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:47.189 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:47.189 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:47.667 INFO:teuthology.orchestra.run.smithi040.stdout:generic/530 [not run] ceph does not support shutdown 2024-09-21T06:32:47.685 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/530 2024-09-21T06:32:47.685 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/530 2024-09-21T06:32:47.685 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:47.688 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:47.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:47.711 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-09-21T06:32:48.003 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:48.010 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:48.010 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:48.012 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:48.346 INFO:teuthology.orchestra.run.smithi040.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-09-21T06:32:48.352 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/531 2024-09-21T06:32:48.352 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/531 2024-09-21T06:32:48.352 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:48.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:48.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:48.383 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-09-21T06:32:48.637 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:48.642 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:48.642 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:48.643 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:48.643 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:49.047 INFO:teuthology.orchestra.run.smithi040.stdout:generic/532 1s 2024-09-21T06:32:49.055 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/532 2024-09-21T06:32:49.055 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:49.058 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:49.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:49.079 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-09-21T06:32:49.364 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:49.369 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:49.369 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:49.371 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:49.371 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:50.396 INFO:teuthology.orchestra.run.smithi040.stdout:generic/533 1s 2024-09-21T06:32:50.405 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/533 2024-09-21T06:32:50.405 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:50.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:50.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:50.429 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-09-21T06:32:50.695 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:50.701 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:50.701 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:50.703 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:51.081 INFO:teuthology.orchestra.run.smithi040.stdout:generic/534 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:32:51.087 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/534 2024-09-21T06:32:51.087 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/534 2024-09-21T06:32:51.087 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:51.090 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:51.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:51.122 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-09-21T06:32:51.389 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:51.395 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:51.736 INFO:teuthology.orchestra.run.smithi040.stdout:generic/535 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:32:51.743 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/535 2024-09-21T06:32:51.743 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/535 2024-09-21T06:32:51.743 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:51.747 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:51.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:51.775 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-09-21T06:32:52.036 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:52.041 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:52.041 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:52.042 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:52.043 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:52.475 INFO:teuthology.orchestra.run.smithi040.stdout:generic/536 [not run] ceph does not support shutdown 2024-09-21T06:32:52.488 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/536 2024-09-21T06:32:52.488 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/536 2024-09-21T06:32:52.489 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:52.492 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:52.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:52.511 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-09-21T06:32:52.786 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:52.790 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:52.791 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:52.792 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:52.792 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:53.278 INFO:teuthology.orchestra.run.smithi040.stdout:generic/537 [not run] FSTRIM not supported 2024-09-21T06:32:53.303 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/537 2024-09-21T06:32:53.303 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/537 2024-09-21T06:32:53.303 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:32:53.306 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:32:53.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:32:53.329 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-09-21T06:32:53.596 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:32:53.600 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:32:53.601 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:32:53.602 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:32:53.602 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:34:19.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:34:19.196 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:34:49.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:34:49.333 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:35:19.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:35:19.402 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:35:49.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:35:49.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:36:19.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:36:19.895 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:36:49.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:36:49.962 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:37:20.098 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:37:20.101 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:37:50.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:37:50.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:38:20.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:38:20.624 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:38:50.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:38:50.707 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:39:20.792 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:39:20.795 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:39:50.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:39:50.887 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:39:50.936 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T06:39:50.934+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52554) UID: 0 2024-09-21T06:39:50.936 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T06:39:50.934+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52554) UID: 0 2024-09-21T06:39:50.937 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T06:39:50.934+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52554) UID: 0 2024-09-21T06:39:50.937 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T06:39:50.934+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52554) UID: 0 2024-09-21T06:40:51.558 INFO:teuthology.orchestra.run.smithi040.stdout:generic/538 478s 2024-09-21T06:40:51.565 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/538 2024-09-21T06:40:51.565 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:40:51.568 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:51.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:40:51.611 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-09-21T06:40:52.125 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:40:52.131 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:40:52.131 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:40:52.133 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:40:52.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:54.501 INFO:teuthology.orchestra.run.smithi040.stdout:generic/539 2s 2024-09-21T06:40:54.510 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/539 2024-09-21T06:40:54.510 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:40:54.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:54.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:40:54.593 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-09-21T06:40:55.112 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:40:55.118 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:40:55.118 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:40:55.119 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:40:55.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:55.691 INFO:teuthology.orchestra.run.smithi040.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T06:40:55.698 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/540 2024-09-21T06:40:55.698 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/540 2024-09-21T06:40:55.698 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:40:55.705 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:56.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:40:56.123 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-09-21T06:40:56.401 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:40:56.407 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:40:56.408 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:40:56.409 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:40:56.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:56.990 INFO:teuthology.orchestra.run.smithi040.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T06:40:57.000 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/541 2024-09-21T06:40:57.000 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/541 2024-09-21T06:40:57.000 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:40:57.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:57.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:40:57.389 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-09-21T06:40:57.688 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:40:57.693 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:40:57.694 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:40:57.696 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:40:57.696 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:58.307 INFO:teuthology.orchestra.run.smithi040.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T06:40:58.321 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/542 2024-09-21T06:40:58.321 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/542 2024-09-21T06:40:58.321 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:40:58.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:58.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:40:58.796 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-09-21T06:40:59.050 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:40:59.055 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:40:59.055 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:40:59.056 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:40:59.056 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:40:59.623 INFO:teuthology.orchestra.run.smithi040.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T06:40:59.633 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/543 2024-09-21T06:40:59.633 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/543 2024-09-21T06:40:59.633 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:40:59.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:00.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:41:00.099 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-09-21T06:41:00.387 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:41:00.393 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:41:00.394 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:41:00.396 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:41:00.396 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:00.998 INFO:teuthology.orchestra.run.smithi040.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T06:41:01.011 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/544 2024-09-21T06:41:01.012 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/544 2024-09-21T06:41:01.012 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:41:01.015 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:01.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:41:01.437 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-09-21T06:41:01.730 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:41:01.736 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:41:01.736 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:41:01.737 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:41:01.737 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:02.169 INFO:teuthology.orchestra.run.smithi040.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-09-21T06:41:02.175 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/545 2024-09-21T06:41:02.176 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/545 2024-09-21T06:41:02.176 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:41:02.180 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:02.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:41:02.224 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-09-21T06:41:02.506 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:41:02.512 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:41:02.513 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:41:02.514 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:41:02.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:02.872 INFO:teuthology.orchestra.run.smithi040.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T06:41:02.879 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/546 2024-09-21T06:41:02.879 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/546 2024-09-21T06:41:02.879 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:41:02.882 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:02.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:41:02.920 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-09-21T06:41:03.216 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:41:03.222 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:41:03.222 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:41:03.223 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:41:03.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:03.603 INFO:teuthology.orchestra.run.smithi040.stdout:generic/547 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:41:03.609 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/547 2024-09-21T06:41:03.609 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/547 2024-09-21T06:41:03.609 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:41:03.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:03.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:41:03.635 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-09-21T06:41:03.903 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:41:03.908 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:41:03.908 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:41:03.910 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:41:03.910 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:04.488 INFO:teuthology.orchestra.run.smithi040.stdout:generic/548 [not run] kernel does not support ceph encryption 2024-09-21T06:41:04.534 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/548 2024-09-21T06:41:04.534 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/548 2024-09-21T06:41:04.534 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:41:04.537 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:04.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:41:04.559 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-09-21T06:41:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:41:04.842 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:41:04.843 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:41:04.844 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:41:04.845 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:05.384 INFO:teuthology.orchestra.run.smithi040.stdout:generic/549 [not run] kernel does not support ceph encryption 2024-09-21T06:41:05.402 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/549 2024-09-21T06:41:05.402 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/549 2024-09-21T06:41:05.402 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:41:05.405 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:05.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:41:05.427 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-09-21T06:41:05.708 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:41:05.713 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:41:05.713 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:41:05.714 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:41:05.714 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:06.259 INFO:teuthology.orchestra.run.smithi040.stdout:generic/550 [not run] kernel does not support ceph encryption 2024-09-21T06:41:06.292 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/550 2024-09-21T06:41:06.292 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/550 2024-09-21T06:41:06.292 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:41:06.296 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:41:06.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:41:06.316 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-09-21T06:41:06.579 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:41:06.584 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:41:06.584 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:41:06.586 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:41:06.586 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:42:55.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:42:55.885 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:43:25.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:43:25.950 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:43:56.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:43:56.338 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:44:26.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:44:26.412 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:44:26.448 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T06:44:26.447+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 603317) UID: 0 2024-09-21T06:44:26.448 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T06:44:26.447+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 603317) UID: 0 2024-09-21T06:48:07.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:48:07.791 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:48:37.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:48:37.993 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:49:08.079 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:49:08.081 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:49:38.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:49:38.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:49:38.538 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T06:49:38.536+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603710) UID: 0 2024-09-21T06:49:38.538 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T06:49:38.536+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603710) UID: 0 2024-09-21T06:49:38.539 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T06:49:38.536+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603710) UID: 0 2024-09-21T06:49:38.539 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T06:49:38.536+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603710) UID: 0 2024-09-21T06:53:04.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:53:04.364 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:53:34.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:53:34.471 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:54:04.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:54:04.666 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:54:34.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:54:34.961 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:55:03.968 INFO:teuthology.orchestra.run.smithi040.stdout:generic/551 837s 2024-09-21T06:55:03.984 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/551 2024-09-21T06:55:03.984 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:03.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:03.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:03.999 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-09-21T06:55:04.274 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:04.279 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:04.279 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:04.280 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:04.280 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:04.747 INFO:teuthology.orchestra.run.smithi040.stdout:generic/552 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:55:04.754 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/552 2024-09-21T06:55:04.754 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/552 2024-09-21T06:55:04.754 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:04.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:04.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:04.784 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-09-21T06:55:05.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:55:05.039 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:55:05.059 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:05.064 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:05.065 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:05.069 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:05.069 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:05.474 INFO:teuthology.orchestra.run.smithi040.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2024-09-21T06:55:05.481 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/553 2024-09-21T06:55:05.481 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/553 2024-09-21T06:55:05.481 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:05.485 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:05.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:05.552 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-09-21T06:55:06.069 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:06.073 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:06.073 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:06.074 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:06.075 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:06.702 INFO:teuthology.orchestra.run.smithi040.stdout:generic/554 [not run] swapfiles are not supported 2024-09-21T06:55:06.710 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/554 2024-09-21T06:55:06.710 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/554 2024-09-21T06:55:06.710 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:06.714 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:06.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:06.795 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-09-21T06:55:07.290 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:07.295 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:07.295 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:07.296 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:07.296 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:07.713 INFO:teuthology.orchestra.run.smithi040.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2024-09-21T06:55:07.719 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/555 2024-09-21T06:55:07.719 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/555 2024-09-21T06:55:07.719 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:07.723 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:07.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:07.783 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-09-21T06:55:08.321 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:08.326 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:08.327 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:08.328 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:08.328 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:08.680 INFO:teuthology.orchestra.run.smithi040.stdout:generic/556 [not run] ceph does not support casefold feature 2024-09-21T06:55:08.686 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/556 2024-09-21T06:55:08.687 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/556 2024-09-21T06:55:08.687 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:08.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:08.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:08.713 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-09-21T06:55:08.998 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:09.004 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:09.004 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:09.006 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:09.006 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:09.359 INFO:teuthology.orchestra.run.smithi040.stdout:generic/557 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:55:09.365 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/557 2024-09-21T06:55:09.366 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/557 2024-09-21T06:55:09.366 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:09.369 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:09.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:09.391 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-09-21T06:55:09.654 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:09.660 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:09.661 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:09.662 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:09.662 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:10.018 INFO:teuthology.orchestra.run.smithi040.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T06:55:10.025 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/558 2024-09-21T06:55:10.025 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/558 2024-09-21T06:55:10.025 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:10.028 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:10.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:10.049 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-09-21T06:55:10.327 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:10.332 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:10.333 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:10.334 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:10.334 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:10.676 INFO:teuthology.orchestra.run.smithi040.stdout:generic/559 [not run] duperemove utility required, skipped this test 2024-09-21T06:55:10.684 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/559 2024-09-21T06:55:10.684 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/559 2024-09-21T06:55:10.684 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:10.688 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:10.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:10.729 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-09-21T06:55:11.015 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:11.021 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:11.021 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:11.023 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:11.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:11.445 INFO:teuthology.orchestra.run.smithi040.stdout:generic/560 [not run] duperemove utility required, skipped this test 2024-09-21T06:55:11.451 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/560 2024-09-21T06:55:11.451 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/560 2024-09-21T06:55:11.451 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:11.455 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:11.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:11.479 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-09-21T06:55:11.734 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:11.739 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:11.739 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:11.741 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:11.741 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:12.208 INFO:teuthology.orchestra.run.smithi040.stdout:generic/561 [not run] duperemove utility required, skipped this test 2024-09-21T06:55:12.215 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/561 2024-09-21T06:55:12.215 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/561 2024-09-21T06:55:12.216 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:12.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:12.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:12.239 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-09-21T06:55:12.519 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:12.524 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:12.524 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:12.525 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:12.525 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:13.106 INFO:teuthology.orchestra.run.smithi040.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T06:55:13.115 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/562 2024-09-21T06:55:13.115 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/562 2024-09-21T06:55:13.115 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:13.123 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:13.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:13.536 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-09-21T06:55:13.809 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:13.814 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:13.815 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:13.816 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:13.816 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:14.184 INFO:teuthology.orchestra.run.smithi040.stdout:generic/563 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:55:14.190 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/563 2024-09-21T06:55:14.191 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/563 2024-09-21T06:55:14.191 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:14.194 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:14.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:14.219 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-09-21T06:55:14.480 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:14.485 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:14.486 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:14.487 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:14.487 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:15.046 INFO:teuthology.orchestra.run.smithi040.stdout:generic/564 1s 2024-09-21T06:55:15.055 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/564 2024-09-21T06:55:15.055 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:15.058 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:15.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:15.140 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-09-21T06:55:15.680 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:15.686 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:15.686 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:15.688 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:15.688 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:16.316 INFO:teuthology.orchestra.run.smithi040.stdout:generic/565 1s 2024-09-21T06:55:16.326 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/565 2024-09-21T06:55:16.326 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:16.333 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:16.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:16.407 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-09-21T06:55:16.936 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:16.942 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:16.943 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:16.944 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:16.944 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:17.284 INFO:teuthology.orchestra.run.smithi040.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T06:55:17.290 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/566 2024-09-21T06:55:17.290 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/566 2024-09-21T06:55:17.290 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:17.293 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:17.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:17.316 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-09-21T06:55:17.609 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:17.615 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:17.616 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:17.617 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:17.617 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:18.444 INFO:teuthology.orchestra.run.smithi040.stdout:generic/567 1s 2024-09-21T06:55:18.453 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/567 2024-09-21T06:55:18.454 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:18.456 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:18.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:18.469 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-09-21T06:55:18.756 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:18.762 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:18.763 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:18.764 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:18.764 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:19.118 INFO:teuthology.orchestra.run.smithi040.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/568 2024-09-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/568 2024-09-21T06:55:19.125 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:19.129 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:19.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:19.161 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-09-21T06:55:19.432 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:19.439 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:19.439 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:19.441 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:19.441 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:19.778 INFO:teuthology.orchestra.run.smithi040.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T06:55:19.787 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/569 2024-09-21T06:55:19.787 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/569 2024-09-21T06:55:19.787 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:19.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:19.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:19.820 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-09-21T06:55:20.076 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:20.083 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:20.085 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:20.085 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:20.450 INFO:teuthology.orchestra.run.smithi040.stdout:generic/570 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:55:20.456 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/570 2024-09-21T06:55:20.456 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/570 2024-09-21T06:55:20.456 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:20.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:20.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:20.482 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-09-21T06:55:20.765 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:20.771 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:20.772 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:20.774 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:20.774 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:21.146 INFO:teuthology.orchestra.run.smithi040.stdout:generic/571 [not run] Require fcntl setlease support 2024-09-21T06:55:21.151 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/571 2024-09-21T06:55:21.151 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/571 2024-09-21T06:55:21.151 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:21.155 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:21.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:21.186 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-09-21T06:55:21.475 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:21.481 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:21.481 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:21.483 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:21.839 INFO:teuthology.orchestra.run.smithi040.stdout:generic/572 [not run] fsverity utility required, skipped this test 2024-09-21T06:55:21.846 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/572 2024-09-21T06:55:21.846 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/572 2024-09-21T06:55:21.846 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:21.850 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:21.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:21.878 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-09-21T06:55:22.166 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:22.174 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:22.175 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:22.176 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:22.176 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:22.500 INFO:teuthology.orchestra.run.smithi040.stdout:generic/573 [not run] fsverity utility required, skipped this test 2024-09-21T06:55:22.509 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/573 2024-09-21T06:55:22.509 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/573 2024-09-21T06:55:22.509 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:22.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:22.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:22.534 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-09-21T06:55:22.813 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:22.817 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:22.817 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:22.819 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:22.819 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:23.135 INFO:teuthology.orchestra.run.smithi040.stdout:generic/574 [not run] fsverity utility required, skipped this test 2024-09-21T06:55:23.146 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/574 2024-09-21T06:55:23.146 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/574 2024-09-21T06:55:23.146 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:23.149 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:23.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:23.181 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-09-21T06:55:23.467 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:23.472 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:23.473 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:23.474 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:23.474 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:23.788 INFO:teuthology.orchestra.run.smithi040.stdout:generic/575 [not run] fsverity utility required, skipped this test 2024-09-21T06:55:23.793 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/575 2024-09-21T06:55:23.793 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/575 2024-09-21T06:55:23.794 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:23.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:23.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:23.817 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-09-21T06:55:24.095 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:24.102 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:24.102 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:24.103 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:24.104 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:24.491 INFO:teuthology.orchestra.run.smithi040.stdout:generic/576 [not run] fsverity utility required, skipped this test 2024-09-21T06:55:24.498 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/576 2024-09-21T06:55:24.498 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/576 2024-09-21T06:55:24.498 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:24.500 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:24.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:24.523 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-09-21T06:55:24.796 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:24.800 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:24.801 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:24.802 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:24.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:25.134 INFO:teuthology.orchestra.run.smithi040.stdout:generic/577 [not run] fsverity utility required, skipped this test 2024-09-21T06:55:25.141 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/577 2024-09-21T06:55:25.141 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/577 2024-09-21T06:55:25.141 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:25.145 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:25.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:25.169 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-09-21T06:55:25.453 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:25.459 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:25.460 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:25.461 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:25.461 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:25.839 INFO:teuthology.orchestra.run.smithi040.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T06:55:25.845 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/578 2024-09-21T06:55:25.845 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/578 2024-09-21T06:55:25.845 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:25.848 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:25.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:25.881 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-09-21T06:55:26.145 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:26.151 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:26.151 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:26.153 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:26.153 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:26.523 INFO:teuthology.orchestra.run.smithi040.stdout:generic/579 [not run] fsverity utility required, skipped this test 2024-09-21T06:55:26.528 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/579 2024-09-21T06:55:26.528 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/579 2024-09-21T06:55:26.529 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:26.531 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:26.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:26.551 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-09-21T06:55:26.840 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:26.845 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:26.846 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:26.847 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:26.847 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:27.382 INFO:teuthology.orchestra.run.smithi040.stdout:generic/580 [not run] kernel does not support ceph encryption 2024-09-21T06:55:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/580 2024-09-21T06:55:27.409 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/580 2024-09-21T06:55:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:27.413 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:27.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:27.436 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-09-21T06:55:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:27.736 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:27.738 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:27.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:generic/581 [not run] kernel does not support ceph encryption 2024-09-21T06:55:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/581 2024-09-21T06:55:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/581 2024-09-21T06:55:28.832 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:28.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:28.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:28.854 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-09-21T06:55:29.139 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:29.145 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:29.147 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:29.147 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:29.690 INFO:teuthology.orchestra.run.smithi040.stdout:generic/582 [not run] kernel does not support ceph encryption 2024-09-21T06:55:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/582 2024-09-21T06:55:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/582 2024-09-21T06:55:29.715 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:29.717 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:29.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:29.737 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-09-21T06:55:30.005 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:30.013 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:30.013 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:generic/583 [not run] kernel does not support ceph encryption 2024-09-21T06:55:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/583 2024-09-21T06:55:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/583 2024-09-21T06:55:30.585 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:30.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:30.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:30.609 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-09-21T06:55:30.884 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:30.889 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:30.891 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:31.441 INFO:teuthology.orchestra.run.smithi040.stdout:generic/584 [not run] kernel does not support ceph encryption 2024-09-21T06:55:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/584 2024-09-21T06:55:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/584 2024-09-21T06:55:31.470 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:31.474 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:31.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:31.499 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-09-21T06:55:31.774 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:31.779 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:31.780 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:31.780 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:32.168 INFO:teuthology.orchestra.run.smithi040.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2024-09-21T06:55:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/585 2024-09-21T06:55:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/585 2024-09-21T06:55:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:32.179 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:32.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:32.230 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-09-21T06:55:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:32.754 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:32.755 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:32.756 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:32.756 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:33.208 INFO:teuthology.orchestra.run.smithi040.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T06:55:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/586 2024-09-21T06:55:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/586 2024-09-21T06:55:33.216 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:33.220 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:33.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:33.267 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-09-21T06:55:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:33.785 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:33.786 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:33.787 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:34.155 INFO:teuthology.orchestra.run.smithi040.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T06:55:34.161 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/587 2024-09-21T06:55:34.161 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/587 2024-09-21T06:55:34.161 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:34.163 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:34.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:34.185 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-09-21T06:55:34.470 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:34.475 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:34.475 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:34.476 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:34.477 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:35.117 INFO:teuthology.orchestra.run.smithi040.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T06:55:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/588 2024-09-21T06:55:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/588 2024-09-21T06:55:35.126 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:35.131 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:35.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:55:35.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:55:35.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:35.491 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-09-21T06:55:35.847 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:35.854 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:35.855 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:35.856 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:35.856 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:36.259 INFO:teuthology.orchestra.run.smithi040.stdout:generic/589 [not run] require 172.21.15.40:6789:/scratch to be local device 2024-09-21T06:55:36.268 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/589 2024-09-21T06:55:36.268 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/589 2024-09-21T06:55:36.269 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:36.272 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:36.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:36.299 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-09-21T06:55:36.645 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:36.649 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:36.649 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:36.651 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:36.651 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:37.026 INFO:teuthology.orchestra.run.smithi040.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T06:55:37.034 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/590 2024-09-21T06:55:37.034 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/590 2024-09-21T06:55:37.034 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:37.038 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:37.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:37.071 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-09-21T06:55:37.385 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:37.390 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:37.390 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:37.392 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:37.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:37.972 INFO:teuthology.orchestra.run.smithi040.stdout:generic/591 0s 2024-09-21T06:55:38.042 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/591 2024-09-21T06:55:38.042 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:38.042 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:38.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:38.049 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-09-21T06:55:38.589 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:38.593 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:38.594 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:38.595 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:38.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:39.113 INFO:teuthology.orchestra.run.smithi040.stdout:generic/592 [not run] kernel does not support ceph encryption 2024-09-21T06:55:39.130 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/592 2024-09-21T06:55:39.130 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/592 2024-09-21T06:55:39.131 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:39.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:39.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:39.160 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-09-21T06:55:39.428 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:39.432 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:39.433 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:39.434 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:39.434 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:39.974 INFO:teuthology.orchestra.run.smithi040.stdout:generic/593 [not run] kernel does not support ceph encryption 2024-09-21T06:55:39.994 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/593 2024-09-21T06:55:39.995 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/593 2024-09-21T06:55:39.995 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:39.997 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:40.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:40.028 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-09-21T06:55:40.308 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:40.313 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:40.313 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:40.315 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:40.315 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:40.698 INFO:teuthology.orchestra.run.smithi040.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T06:55:40.704 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/594 2024-09-21T06:55:40.704 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/594 2024-09-21T06:55:40.704 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:40.708 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:40.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:40.738 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-09-21T06:55:41.014 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:41.019 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:41.020 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:41.021 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:41.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:41.566 INFO:teuthology.orchestra.run.smithi040.stdout:generic/595 [not run] kernel does not support ceph encryption 2024-09-21T06:55:41.592 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/595 2024-09-21T06:55:41.592 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/595 2024-09-21T06:55:41.592 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:41.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:41.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:41.621 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-09-21T06:55:41.896 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:41.901 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:41.902 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:41.905 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:41.906 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:42.350 INFO:teuthology.orchestra.run.smithi040.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-09-21T06:55:42.358 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/596 2024-09-21T06:55:42.358 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/596 2024-09-21T06:55:42.358 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:42.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:42.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:42.392 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-09-21T06:55:42.682 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:42.687 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:42.687 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:42.689 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:42.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:44.765 INFO:teuthology.orchestra.run.smithi040.stdout:generic/597 2s 2024-09-21T06:55:44.786 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/597 2024-09-21T06:55:44.786 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:44.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:44.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:44.846 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-09-21T06:55:45.414 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:45.418 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:45.419 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:45.420 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:45.420 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:46.415 INFO:teuthology.orchestra.run.smithi040.stdout:generic/598 1s 2024-09-21T06:55:46.426 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/598 2024-09-21T06:55:46.426 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:46.428 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:46.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:46.491 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-09-21T06:55:47.020 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:47.025 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:47.026 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:47.027 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:47.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:47.487 INFO:teuthology.orchestra.run.smithi040.stdout:generic/599 [not run] ceph does not support shutdown 2024-09-21T06:55:47.510 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/599 2024-09-21T06:55:47.511 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/599 2024-09-21T06:55:47.511 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:47.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:47.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:47.537 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-09-21T06:55:47.798 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:47.807 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:47.808 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:47.809 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:47.809 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:48.149 INFO:teuthology.orchestra.run.smithi040.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T06:55:48.156 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/600 2024-09-21T06:55:48.156 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/600 2024-09-21T06:55:48.156 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:48.158 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:48.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:48.182 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-09-21T06:55:48.454 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:48.463 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:48.463 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:48.464 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:48.464 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:48.809 INFO:teuthology.orchestra.run.smithi040.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T06:55:48.816 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/601 2024-09-21T06:55:48.816 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/601 2024-09-21T06:55:48.816 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:48.819 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:48.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:48.841 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-09-21T06:55:49.125 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:49.136 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:49.136 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:49.138 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:49.138 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:49.677 INFO:teuthology.orchestra.run.smithi040.stdout:generic/602 [not run] kernel does not support ceph encryption 2024-09-21T06:55:49.694 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/602 2024-09-21T06:55:49.694 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/602 2024-09-21T06:55:49.694 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:49.695 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:49.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:49.715 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-09-21T06:55:49.991 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:50.001 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:50.001 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:50.002 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:50.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:50.356 INFO:teuthology.orchestra.run.smithi040.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T06:55:50.362 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/603 2024-09-21T06:55:50.362 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/603 2024-09-21T06:55:50.362 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:50.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:50.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:50.388 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-09-21T06:55:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:50.672 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:50.675 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:55.498 INFO:teuthology.orchestra.run.smithi040.stdout:generic/604 5s 2024-09-21T06:55:55.507 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/604 2024-09-21T06:55:55.507 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:55.510 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:55.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:55.523 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-09-21T06:55:55.821 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:55.830 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:55.830 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:55.837 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:55.837 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:57.926 INFO:teuthology.orchestra.run.smithi040.stdout:generic/605 [not run] mount 172.21.15.40:6789:/scratch with dax=always failed 2024-09-21T06:55:57.931 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/605 2024-09-21T06:55:57.932 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/605 2024-09-21T06:55:57.932 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:57.934 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:57.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:57.955 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-09-21T06:55:58.232 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:58.238 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:58.238 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:58.240 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:58.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:58.673 INFO:teuthology.orchestra.run.smithi040.stdout:generic/606 [not run] mount 172.21.15.40:6789:/scratch with dax=always failed 2024-09-21T06:55:58.678 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/606 2024-09-21T06:55:58.679 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/606 2024-09-21T06:55:58.679 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:58.682 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:58.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:58.755 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-09-21T06:55:59.042 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:55:59.048 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:55:59.049 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:55:59.050 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:55:59.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:59.409 INFO:teuthology.orchestra.run.smithi040.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2024-09-21T06:55:59.415 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/607 2024-09-21T06:55:59.416 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/607 2024-09-21T06:55:59.416 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:55:59.419 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:55:59.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:55:59.469 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-09-21T06:56:00.035 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:56:00.042 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:56:00.042 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:56:00.044 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:56:00.044 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:00.527 INFO:teuthology.orchestra.run.smithi040.stdout:generic/608 [not run] mount 172.21.15.40:6789:/scratch with dax=always failed 2024-09-21T06:56:00.533 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/608 2024-09-21T06:56:00.533 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/608 2024-09-21T06:56:00.533 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:56:00.537 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:00.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:56:00.558 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-09-21T06:56:00.844 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:56:00.852 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:56:00.852 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:56:00.853 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:56:00.853 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:01.510 INFO:teuthology.orchestra.run.smithi040.stdout:generic/609 0s 2024-09-21T06:56:01.518 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/609 2024-09-21T06:56:01.518 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:56:01.521 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:01.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:56:01.585 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-09-21T06:56:02.123 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:56:02.128 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:56:02.128 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:56:02.129 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:56:02.130 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:02.590 INFO:teuthology.orchestra.run.smithi040.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-21T06:56:02.596 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/610 2024-09-21T06:56:02.596 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/610 2024-09-21T06:56:02.596 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:56:02.603 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:02.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:56:02.639 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-09-21T06:56:02.933 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:56:02.938 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:56:02.938 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:56:02.940 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:56:02.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:03.664 INFO:teuthology.orchestra.run.smithi040.stdout:generic/611 0s 2024-09-21T06:56:03.673 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/611 2024-09-21T06:56:03.673 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:56:03.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:03.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:56:03.690 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-09-21T06:56:03.964 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:56:03.969 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:56:03.970 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:56:03.971 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:56:03.971 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:04.405 INFO:teuthology.orchestra.run.smithi040.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T06:56:04.412 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/612 2024-09-21T06:56:04.412 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/612 2024-09-21T06:56:04.412 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:56:04.415 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:04.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:56:04.490 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-09-21T06:56:05.107 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:56:05.112 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:56:05.112 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:56:05.114 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:56:05.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:05.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:56:05.250 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:56:05.749 INFO:teuthology.orchestra.run.smithi040.stdout:generic/613 [not run] kernel does not support ceph encryption 2024-09-21T06:56:05.777 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/613 2024-09-21T06:56:05.777 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/613 2024-09-21T06:56:05.777 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:56:05.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:05.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:56:05.808 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-09-21T06:56:06.100 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:56:06.105 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:56:06.106 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:56:06.107 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:56:06.107 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:06.677 INFO:teuthology.orchestra.run.smithi040.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2024-09-21T06:56:06.703 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/614 2024-09-21T06:56:06.703 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/614 2024-09-21T06:56:06.703 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:56:06.707 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:06.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:56:06.733 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-09-21T06:56:07.009 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:56:07.015 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:56:07.016 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:56:07.017 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:56:07.017 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:56:35.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:56:35.357 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:57:05.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:57:05.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:57:06.371 INFO:teuthology.orchestra.run.smithi040.stdout:generic/615 59s 2024-09-21T06:57:06.384 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/615 2024-09-21T06:57:06.384 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:06.387 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:06.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:06.397 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-09-21T06:57:06.673 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:06.680 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:06.682 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:06.685 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:06.685 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:07.057 INFO:teuthology.orchestra.run.smithi040.stdout:generic/616 [not run] kernel does not support IO_URING 2024-09-21T06:57:07.064 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/616 2024-09-21T06:57:07.064 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/616 2024-09-21T06:57:07.064 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:07.072 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:07.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:07.093 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-09-21T06:57:07.358 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:07.363 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:07.364 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:07.365 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:07.365 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:07.782 INFO:teuthology.orchestra.run.smithi040.stdout:generic/617 [not run] kernel does not support IO_URING 2024-09-21T06:57:07.789 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/617 2024-09-21T06:57:07.789 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/617 2024-09-21T06:57:07.789 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:07.792 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:07.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:07.814 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-09-21T06:57:08.098 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:08.104 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:08.104 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:08.105 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:08.106 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:08.861 INFO:teuthology.orchestra.run.smithi040.stdout:generic/618 0s 2024-09-21T06:57:08.871 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/618 2024-09-21T06:57:08.872 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:08.877 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:08.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:08.891 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-09-21T06:57:09.155 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:09.160 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:09.161 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:09.162 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:09.162 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:09.520 INFO:teuthology.orchestra.run.smithi040.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T06:57:09.527 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/619 2024-09-21T06:57:09.528 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/619 2024-09-21T06:57:09.528 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:09.532 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:09.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:09.572 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-09-21T06:57:09.848 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:09.853 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:09.853 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:09.855 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:09.855 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:10.219 INFO:teuthology.orchestra.run.smithi040.stdout:generic/620 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:57:10.226 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/620 2024-09-21T06:57:10.227 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/620 2024-09-21T06:57:10.227 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:10.230 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:10.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:10.252 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-09-21T06:57:10.528 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:10.532 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:10.533 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:10.535 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:10.535 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:11.071 INFO:teuthology.orchestra.run.smithi040.stdout:generic/621 [not run] kernel does not support ceph encryption 2024-09-21T06:57:11.085 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/621 2024-09-21T06:57:11.086 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/621 2024-09-21T06:57:11.086 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:11.088 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:11.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:11.108 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-09-21T06:57:11.384 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:11.390 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:11.391 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:11.392 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:11.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:11.869 INFO:teuthology.orchestra.run.smithi040.stdout:generic/622 [not run] ceph does not support shutdown 2024-09-21T06:57:11.892 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/622 2024-09-21T06:57:11.892 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/622 2024-09-21T06:57:11.892 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:11.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:11.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:11.914 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-09-21T06:57:12.184 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:12.189 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:12.189 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:12.190 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:12.191 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:12.686 INFO:teuthology.orchestra.run.smithi040.stdout:generic/623 [not run] ceph does not support shutdown 2024-09-21T06:57:12.699 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/623 2024-09-21T06:57:12.699 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/623 2024-09-21T06:57:12.699 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:12.702 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:12.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:12.730 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-09-21T06:57:13.012 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:13.016 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:13.016 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:13.018 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:13.018 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:13.334 INFO:teuthology.orchestra.run.smithi040.stdout:generic/624 [not run] fsverity utility required, skipped this test 2024-09-21T06:57:13.340 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/624 2024-09-21T06:57:13.340 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/624 2024-09-21T06:57:13.340 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:13.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:13.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:13.372 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-09-21T06:57:13.655 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:13.661 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:13.661 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:13.662 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:13.996 INFO:teuthology.orchestra.run.smithi040.stdout:generic/625 [not run] fsverity utility required, skipped this test 2024-09-21T06:57:14.002 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/625 2024-09-21T06:57:14.002 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/625 2024-09-21T06:57:14.002 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:14.006 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:14.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:14.024 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-09-21T06:57:14.324 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:14.329 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:14.329 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:14.330 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:14.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:14.719 INFO:teuthology.orchestra.run.smithi040.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2024-09-21T06:57:14.725 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/626 2024-09-21T06:57:14.725 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/626 2024-09-21T06:57:14.725 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:14.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:14.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:14.784 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-09-21T06:57:15.316 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:15.323 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:15.324 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:15.325 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:15.325 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:15.780 INFO:teuthology.orchestra.run.smithi040.stdout:generic/627 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:57:15.785 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/627 2024-09-21T06:57:15.785 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/627 2024-09-21T06:57:15.785 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:15.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:15.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:15.817 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-09-21T06:57:16.087 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:16.092 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:16.093 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:16.094 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:16.094 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:16.738 INFO:teuthology.orchestra.run.smithi040.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T06:57:16.755 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/628 2024-09-21T06:57:16.755 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/628 2024-09-21T06:57:16.755 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:16.764 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:17.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:17.093 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-09-21T06:57:17.430 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:17.437 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:17.437 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:17.439 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:17.439 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:17.801 INFO:teuthology.orchestra.run.smithi040.stdout:generic/629 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:57:17.808 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/629 2024-09-21T06:57:17.808 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/629 2024-09-21T06:57:17.808 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:17.812 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:17.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:17.845 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-09-21T06:57:18.123 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:18.127 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:18.128 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:18.129 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:18.129 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:18.661 INFO:teuthology.orchestra.run.smithi040.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-09-21T06:57:18.722 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/630 2024-09-21T06:57:18.722 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/630 2024-09-21T06:57:18.722 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:18.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:19.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:19.168 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-09-21T06:57:19.450 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:19.456 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:19.456 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:19.457 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:19.458 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:35.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:57:35.600 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:57:50.431 INFO:teuthology.orchestra.run.smithi040.stdout:generic/631 - output mismatch (see /tmp/tmp.9vjfAyR2gpxfstests-dev/results//generic/631.out.bad) 2024-09-21T06:57:50.449 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/631.out 2024-09-21 01:50:30.719530213 +0000 2024-09-21T06:57:50.449 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.9vjfAyR2gpxfstests-dev/results//generic/631.out.bad 2024-09-21 06:57:50.405495008 +0000 2024-09-21T06:57:50.449 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,2 +1,3674 @@ 2024-09-21T06:57:50.449 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 631 2024-09-21T06:57:50.449 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.449 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.449 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.449 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.450 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.451 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.452 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.453 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.454 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.455 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.456 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.457 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.458 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.459 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.460 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.461 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.462 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.463 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.464 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.465 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.469 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.470 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.471 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted./tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.472 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.473 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.474 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.475 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.476 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.477 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.478 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.479 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.480 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.492 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.493 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.494 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.495 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.496 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.497 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.498 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.499 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.500 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.501 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.502 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.503 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.504 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.505 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.506 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.507 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.508 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.509 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.510 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.511 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.512 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.513 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.514 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.516 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.519 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.521 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.522 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.523 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.524 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.525 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.526 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.527 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.528 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.529 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.530 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.532 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.533 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.535 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.536 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted./tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.537 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.538 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.539 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted./tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.540 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.541 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.542 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.543 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.544 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.545 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.546 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.547 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.548 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.550 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.551 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.552 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.553 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.554 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.555 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.556 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.557 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.558 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.559 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.561 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.563 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.564 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.565 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.569 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.570 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.573 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.574 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.575 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.576 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.577 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.578 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.579 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.580 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.581 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf' 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +: No such file or directory 2024-09-21T06:57:50.582 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted./tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.584 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.585 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.586 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.587 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.588 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.589 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.590 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.591 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.592 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.593 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.594 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.595 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted./tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.596 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.597 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.598 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.600 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf'umount: : No such file or directory/tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.602 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.603 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.604 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.605 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.606 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.607 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.608 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.609 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.610 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.611 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.612 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf' 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +: No such file or directory 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.614 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.615 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf'umount: : No such file or directory/tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.616 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.617 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.618 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.619 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.620 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.621 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.622 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.623 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.624 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.625 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.628 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.629 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.630 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.631 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.632 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.632 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.632 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.632 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.632 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.633 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.633 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.633 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.633 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.634 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.635 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.636 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.637 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.638 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.639 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.640 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.641 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.642 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.642 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.642 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.642 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.642 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.642 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.642 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:57:50.646 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.646 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.646 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.646 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.647 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.649 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.650 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.651 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.652 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.653 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.654 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.656 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +/tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf' 2024-09-21T06:57:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: +: No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.658 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.660 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.661 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.662 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted./tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.663 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.666 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.667 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.668 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.669 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.670 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf' 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +: No such file or directory 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted./tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.671 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.672 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.673 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.674 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.676 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.677 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.678 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted./tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.679 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.680 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.681 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.683 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directoryumount: 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +/tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.685 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.686 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.687 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.688 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.689 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.690 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.691 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.692 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.693 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.694 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.695 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.696 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +/tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: + 2024-09-21T06:57:50.697 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.698 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.699 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.701 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.702 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.703 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.704 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.705 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.706 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.707 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf' 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +: No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.708 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.709 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: touch: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf' 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +: No such file or directory 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.711 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.712 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged5/etc/access.conf': No such file or directory 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged5: not mounted. 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged2/etc/access.conf': No such file or directory 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged2: not mounted. 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.713 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged1/etc/access.conf': No such file or directory 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged1: not mounted. 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged3/etc/access.conf': No such file or directory 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged0/etc/access.conf': No such file or directory 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged3: not mounted. 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged0: not mounted. 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +mount: /tmp/tmp.j6CdXJYUQdscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-09-21T06:57:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout: +mv: cannot stat '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout: +touch: cannot touch '/tmp/tmp.j6CdXJYUQdscratch/merged4/etc/access.conf': No such file or directory 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.j6CdXJYUQdscratch/merged4: not mounted. 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout: Silence is golden. 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout:HINT: You _MAY_ be missing kernel fix: 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/631 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/631 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2024-09-21T06:57:50.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:50.715 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-09-21T06:57:50.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-09-21T06:57:50.716 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-09-21T06:57:51.003 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:51.009 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:51.009 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:51.010 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:51.010 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:52.225 INFO:teuthology.orchestra.run.smithi040.stdout:generic/632 1s 2024-09-21T06:57:52.235 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/632 2024-09-21T06:57:52.235 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:52.238 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:52.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:52.272 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-09-21T06:57:52.543 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:52.551 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:52.551 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:52.552 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:52.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:53.679 INFO:teuthology.orchestra.run.smithi040.stdout:generic/633 1s 2024-09-21T06:57:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/633 2024-09-21T06:57:53.687 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:53.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:53.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:53.802 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-09-21T06:57:54.292 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:54.296 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:54.297 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:54.298 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:54.298 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:55.722 INFO:teuthology.orchestra.run.smithi040.stdout:generic/634 1s 2024-09-21T06:57:55.755 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/634 2024-09-21T06:57:55.755 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:55.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:55.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:55.771 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-09-21T06:57:56.060 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:56.064 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:56.065 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:56.066 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:56.066 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:56.561 INFO:teuthology.orchestra.run.smithi040.stdout:generic/635 [not run] ceph does not support shutdown 2024-09-21T06:57:56.577 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/635 2024-09-21T06:57:56.577 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/635 2024-09-21T06:57:56.577 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:56.579 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:56.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:56.599 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-09-21T06:57:56.873 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:56.878 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:56.879 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:56.880 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:56.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:57.434 INFO:teuthology.orchestra.run.smithi040.stdout:generic/636 [not run] swapfiles are not supported 2024-09-21T06:57:57.440 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/636 2024-09-21T06:57:57.440 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/636 2024-09-21T06:57:57.440 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:57.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:57.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:57.474 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-09-21T06:57:57.750 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:57.756 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:57.756 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:57.758 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:57.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:58.810 INFO:teuthology.orchestra.run.smithi040.stdout:generic/637 1s 2024-09-21T06:57:58.823 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/637 2024-09-21T06:57:58.823 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:58.825 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:59.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:59.013 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-09-21T06:57:59.515 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:57:59.520 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:57:59.520 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:57:59.521 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:57:59.521 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:59.942 INFO:teuthology.orchestra.run.smithi040.stdout:generic/638 0s 2024-09-21T06:57:59.951 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/638 2024-09-21T06:57:59.951 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:57:59.955 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:57:59.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:57:59.995 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-09-21T06:58:00.266 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:58:00.271 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:58:00.272 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:58:00.273 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:58:00.273 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:58:00.768 INFO:teuthology.orchestra.run.smithi040.stdout:generic/639 0s 2024-09-21T06:58:00.775 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/639 2024-09-21T06:58:00.775 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:58:00.777 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:58:00.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:58:00.852 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-09-21T06:58:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:58:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:58:01.141 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:58:01.144 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:58:01.144 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:58:01.509 INFO:teuthology.orchestra.run.smithi040.stdout:generic/640 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T06:58:01.515 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/640 2024-09-21T06:58:01.515 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/640 2024-09-21T06:58:01.515 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:58:01.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:58:01.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:58:01.541 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-09-21T06:58:01.814 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:58:01.819 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:58:01.819 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:58:01.819 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:58:01.819 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:58:02.381 INFO:teuthology.orchestra.run.smithi040.stdout:generic/641 [not run] swapfiles are not supported 2024-09-21T06:58:02.388 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/641 2024-09-21T06:58:02.388 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/641 2024-09-21T06:58:02.388 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T06:58:02.391 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:58:02.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T06:58:02.421 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-09-21T06:58:02.699 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T06:58:02.704 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T06:58:02.704 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T06:58:02.705 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T06:58:02.705 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T06:58:05.693 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:58:05.696 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:58:35.780 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:58:35.782 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:06.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:06.186 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:36.433 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:36.438 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:00:06.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:00:06.532 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:00:36.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:00:36.829 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:07.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:07.167 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:37.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:37.251 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:02:07.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:02:07.698 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:02:07.737 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T07:02:07.735+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 697717) UID: 0 2024-09-21T07:02:07.737 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T07:02:07.735+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 697717) UID: 0 2024-09-21T07:04:56.846 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T07:04:56.843+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697723) UID: 0 2024-09-21T07:04:56.846 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T07:04:56.843+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697723) UID: 0 2024-09-21T07:04:56.846 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T07:04:56.843+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697723) UID: 0 2024-09-21T07:04:56.847 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T07:04:56.843+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 697723) UID: 0 2024-09-21T07:09:16.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:09:16.988 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:09:17.021 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T07:09:17.020+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 697747) UID: 0 2024-09-21T07:09:17.022 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T07:09:17.020+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 697747) UID: 0 2024-09-21T07:09:17.022 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T07:09:17.021+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53131) UID: 0 2024-09-21T07:09:17.022 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T07:09:17.021+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53131) UID: 0 2024-09-21T07:09:17.023 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T07:09:17.021+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53131) UID: 0 2024-09-21T07:09:17.023 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T07:09:17.021+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53131) UID: 0 2024-09-21T07:12:01.232 INFO:teuthology.orchestra.run.smithi040.stdout:generic/642 839s 2024-09-21T07:12:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/642 2024-09-21T07:12:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T07:12:01.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:12:01.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T07:12:01.274 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-09-21T07:12:03.357 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T07:12:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T07:12:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T07:12:03.363 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T07:12:03.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:15:51.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:15:51.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:15:51.678 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T07:15:51.676+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 698053) UID: 0 2024-09-21T07:15:51.678 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T07:15:51.676+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 698053) UID: 0 2024-09-21T07:17:08.955 INFO:teuthology.orchestra.run.smithi040.stdout:generic/643 [not run] swapfiles are not supported 2024-09-21T07:17:08.962 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/643 2024-09-21T07:17:08.962 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/643 2024-09-21T07:17:08.962 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T07:17:08.966 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:08.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T07:17:08.994 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-09-21T07:17:09.303 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T07:17:09.308 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T07:17:09.309 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T07:17:09.310 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T07:17:09.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:09.716 INFO:teuthology.orchestra.run.smithi040.stdout:generic/644 [not run] vfstest not support by ceph 2024-09-21T07:17:09.722 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/644 2024-09-21T07:17:09.722 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/644 2024-09-21T07:17:09.722 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T07:17:09.725 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:09.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T07:17:09.749 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-09-21T07:17:10.054 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T07:17:10.059 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T07:17:10.060 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T07:17:10.061 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T07:17:10.061 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:10.455 INFO:teuthology.orchestra.run.smithi040.stdout:generic/645 [not run] vfstest not support by ceph 2024-09-21T07:17:10.462 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/645 2024-09-21T07:17:10.462 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/645 2024-09-21T07:17:10.462 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T07:17:10.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:10.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T07:17:10.504 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-09-21T07:17:10.823 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T07:17:10.829 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T07:17:10.830 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T07:17:10.831 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T07:17:10.831 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:11.496 INFO:teuthology.orchestra.run.smithi040.stdout:generic/646 [not run] ceph does not support shutdown 2024-09-21T07:17:11.518 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/646 2024-09-21T07:17:11.518 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/646 2024-09-21T07:17:11.518 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T07:17:11.522 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:11.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T07:17:11.546 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-09-21T07:17:11.877 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T07:17:11.881 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T07:17:11.882 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T07:17:11.883 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T07:17:11.883 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:13.098 INFO:teuthology.orchestra.run.smithi040.stdout:generic/647 1s 2024-09-21T07:17:13.148 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/647 2024-09-21T07:17:13.148 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T07:17:13.151 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:13.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T07:17:13.201 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-09-21T07:17:13.775 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T07:17:13.787 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T07:17:13.788 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T07:17:13.791 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T07:17:13.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:14.979 INFO:teuthology.orchestra.run.smithi040.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T07:17:14.989 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/648 2024-09-21T07:17:14.989 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/648 2024-09-21T07:17:14.989 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T07:17:15.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:15.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T07:17:15.060 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-09-21T07:17:15.439 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T07:17:15.445 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T07:17:15.446 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T07:17:15.447 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T07:17:15.447 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:16.229 INFO:teuthology.orchestra.run.smithi040.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T07:17:16.237 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/649 2024-09-21T07:17:16.237 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/649 2024-09-21T07:17:16.237 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T07:17:16.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:17:16.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T07:17:16.310 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-09-21T07:17:16.914 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T07:17:16.919 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T07:17:16.920 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T07:17:16.921 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T07:17:16.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T07:20:12.709 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T07:20:12.707+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701827) UID: 0 2024-09-21T07:20:12.709 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T07:20:12.707+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 701827) UID: 0 2024-09-21T07:20:12.713 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T07:20:12.709+0000 7fdab7f1b640 -1 Fail to open '/proc/701827/cmdline' error = (2) No such file or directory 2024-09-21T07:20:12.714 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T07:20:12.709+0000 7fdab7f1b640 -1 received signal: Hangup from (PID: 701827) UID: 0 2024-09-21T07:20:12.715 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T07:20:12.708+0000 7f843b458640 -1 Fail to open '/proc/701827/cmdline' error = (2) No such file or directory 2024-09-21T07:20:12.716 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T07:20:12.709+0000 7f843b458640 -1 received signal: Hangup from (PID: 701827) UID: 0 2024-09-21T07:25:12.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:25:12.372 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:25:42.529 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:25:42.533 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:26:12.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:26:12.647 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:26:42.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:26:42.843 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:27:13.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:27:13.058 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:27:43.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:27:43.185 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:28:13.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:28:13.509 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:28:43.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:28:44.026 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:29:14.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:29:14.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:29:44.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:29:44.392 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:30:14.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:30:14.500 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:30:44.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:30:44.624 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:31:14.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:31:14.848 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:31:44.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:31:44.991 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:32:15.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:32:15.124 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:32:45.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:32:45.262 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:33:15.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:33:15.393 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:33:45.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:33:45.549 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:34:15.729 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:34:15.734 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:34:15.762 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T07:34:15.761+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53519) UID: 0 2024-09-21T07:34:15.762 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T07:34:15.761+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53519) UID: 0 2024-09-21T07:34:15.762 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T07:34:15.761+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53519) UID: 0 2024-09-21T07:34:15.763 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T07:34:15.761+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53519) UID: 0 2024-09-21T07:37:03.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:37:03.513 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:37:33.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:37:33.667 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:38:03.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:38:03.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:38:33.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:38:33.950 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:39:04.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:39:04.066 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:39:34.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:39:34.227 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:04.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:04.379 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:34.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:40:34.554 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:41:04.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:41:04.708 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:41:35.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:41:35.066 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:42:05.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:42:05.192 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:42:35.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:42:35.337 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:43:05.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:43:05.493 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:43:35.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:43:35.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:43:35.683 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T07:43:35.682+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53808) UID: 0 2024-09-21T07:43:35.683 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T07:43:35.681+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53808) UID: 0 2024-09-21T07:43:35.683 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T07:43:35.681+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53808) UID: 0 2024-09-21T07:43:35.684 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T07:43:35.681+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53808) UID: 0 2024-09-21T07:46:20.336 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:46:20.342 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:46:50.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:46:50.541 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:47:20.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:47:20.738 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:47:50.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:47:50.935 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:48:21.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:48:21.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:48:51.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:48:51.228 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:49:21.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:49:21.379 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:49:51.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:49:51.600 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:50:21.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:50:21.753 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:50:51.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:50:51.857 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:51:22.154 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:51:22.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:51:52.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:51:52.665 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:52:22.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:52:22.852 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:52:53.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:52:53.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:52:53.200 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T07:52:53.198+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 706958) UID: 0 2024-09-21T07:52:53.200 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T07:52:53.199+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 706958) UID: 0 2024-09-21T07:52:53.202 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T07:52:53.199+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 706958) UID: 0 2024-09-21T07:52:53.231 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T07:52:53.199+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 706958) UID: 0 2024-09-21T07:57:46.939 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:57:46.942 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:57:47.065 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T07:57:47.064+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 707624) UID: 0 2024-09-21T07:57:47.071 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T07:57:47.070+0000 7f5dff06b640 -1 Fail to open '/proc/707624/cmdline' error = (2) No such file or directory 2024-09-21T07:57:47.071 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T07:57:47.070+0000 7f5dff06b640 -1 received signal: Hangup from (PID: 707624) UID: 0 2024-09-21T08:03:33.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:03:33.017 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:04:03.201 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:04:03.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:04:33.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:04:33.383 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:05:03.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:05:03.559 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:05:33.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:05:33.666 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:06:03.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:06:03.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:06:34.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:06:34.018 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:06:34.050 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T08:06:34.048+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54253) UID: 0 2024-09-21T08:06:34.050 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T08:06:34.048+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54253) UID: 0 2024-09-21T08:06:34.050 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T08:06:34.048+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54253) UID: 0 2024-09-21T08:06:34.050 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T08:06:34.048+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54253) UID: 0 2024-09-21T08:09:24.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:09:24.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:09:54.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:09:54.492 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:10:24.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:10:24.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:10:54.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:10:54.856 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:11:24.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:11:24.933 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:11:55.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:11:55.063 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:12:25.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:12:25.258 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:12:55.389 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:12:55.392 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:13:13.246 INFO:teuthology.orchestra.run.smithi040.stdout:generic/650 3355s 2024-09-21T08:13:13.484 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/650 2024-09-21T08:13:13.484 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:13.487 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:13.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:13.576 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-09-21T08:13:14.220 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:14.236 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:14.237 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:14.239 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:14.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:15.954 INFO:teuthology.orchestra.run.smithi040.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:15.983 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/651 2024-09-21T08:13:15.984 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/651 2024-09-21T08:13:15.984 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:15.995 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:16.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:16.392 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-09-21T08:13:17.097 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:17.113 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:17.115 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:17.119 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:17.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:18.433 INFO:teuthology.orchestra.run.smithi040.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:18.444 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/652 2024-09-21T08:13:18.444 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/652 2024-09-21T08:13:18.444 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:18.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:18.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:18.916 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-09-21T08:13:19.682 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:19.687 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:19.687 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:19.689 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:20.860 INFO:teuthology.orchestra.run.smithi040.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:20.884 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/653 2024-09-21T08:13:20.884 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/653 2024-09-21T08:13:20.885 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:20.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:21.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:21.465 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-09-21T08:13:22.090 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:22.104 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:22.105 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:22.108 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:22.108 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:23.386 INFO:teuthology.orchestra.run.smithi040.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:23.411 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/654 2024-09-21T08:13:23.411 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/654 2024-09-21T08:13:23.411 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:23.423 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:23.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:23.931 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-09-21T08:13:24.698 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:24.714 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:24.714 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:24.717 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:24.717 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:25.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:13:25.523 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:13:25.930 INFO:teuthology.orchestra.run.smithi040.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:25.973 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/655 2024-09-21T08:13:25.973 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/655 2024-09-21T08:13:25.973 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:25.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:26.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:26.431 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-09-21T08:13:27.157 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:27.170 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:27.172 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:27.174 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:27.174 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:27.908 INFO:teuthology.orchestra.run.smithi040.stdout:generic/656 [not run] vfstest not support by ceph 2024-09-21T08:13:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/656 2024-09-21T08:13:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/656 2024-09-21T08:13:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:27.926 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:27.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:27.968 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-09-21T08:13:28.562 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:28.575 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:28.576 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:28.576 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/657 2024-09-21T08:13:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/657 2024-09-21T08:13:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:29.814 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:30.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:30.415 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-09-21T08:13:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:31.054 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:31.055 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:31.059 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:31.059 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:32.377 INFO:teuthology.orchestra.run.smithi040.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/658 2024-09-21T08:13:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/658 2024-09-21T08:13:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:32.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:32.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:32.925 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-09-21T08:13:33.683 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:33.691 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:33.692 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:33.693 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:33.693 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:35.061 INFO:teuthology.orchestra.run.smithi040.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:35.080 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/659 2024-09-21T08:13:35.080 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/659 2024-09-21T08:13:35.080 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:35.097 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:35.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:35.662 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-09-21T08:13:36.238 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:36.243 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:36.243 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:36.246 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:36.246 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:37.512 INFO:teuthology.orchestra.run.smithi040.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:37.530 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/660 2024-09-21T08:13:37.530 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/660 2024-09-21T08:13:37.531 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:37.544 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:38.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:38.114 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-09-21T08:13:38.834 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:38.843 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:38.844 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:38.847 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:38.847 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:40.213 INFO:teuthology.orchestra.run.smithi040.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:40.232 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/661 2024-09-21T08:13:40.232 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/661 2024-09-21T08:13:40.233 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:40.244 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:40.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:40.825 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-09-21T08:13:41.437 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:41.451 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:41.454 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:41.457 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:41.457 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:42.695 INFO:teuthology.orchestra.run.smithi040.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:42.708 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/662 2024-09-21T08:13:42.708 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/662 2024-09-21T08:13:42.708 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:42.714 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:42.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:42.896 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-09-21T08:13:43.739 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:43.756 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:43.758 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:43.761 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:43.761 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:44.985 INFO:teuthology.orchestra.run.smithi040.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:45.010 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/663 2024-09-21T08:13:45.011 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/663 2024-09-21T08:13:45.011 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:45.032 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:45.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:45.579 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-09-21T08:13:46.227 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:46.244 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:46.247 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:46.251 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:46.251 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:47.558 INFO:teuthology.orchestra.run.smithi040.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:47.568 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/664 2024-09-21T08:13:47.568 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/664 2024-09-21T08:13:47.569 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:47.573 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:48.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:48.294 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-09-21T08:13:48.934 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:48.948 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:48.950 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:48.954 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:48.954 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:50.355 INFO:teuthology.orchestra.run.smithi040.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:50.382 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/665 2024-09-21T08:13:50.382 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/665 2024-09-21T08:13:50.383 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:50.393 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:51.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:51.040 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-09-21T08:13:51.646 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:51.656 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:51.656 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:51.657 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:51.657 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:53.111 INFO:teuthology.orchestra.run.smithi040.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:53.132 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/666 2024-09-21T08:13:53.132 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/666 2024-09-21T08:13:53.133 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:53.143 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:53.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:53.706 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-09-21T08:13:54.350 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:54.366 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:54.367 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:54.368 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:54.368 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:55.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:13:55.688 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:13:55.776 INFO:teuthology.orchestra.run.smithi040.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:55.799 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/667 2024-09-21T08:13:55.799 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/667 2024-09-21T08:13:55.799 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:55.825 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:56.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:56.247 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-09-21T08:13:56.943 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:56.956 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:56.957 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:56.958 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:56.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:58.239 INFO:teuthology.orchestra.run.smithi040.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:13:58.260 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/668 2024-09-21T08:13:58.260 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/668 2024-09-21T08:13:58.260 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:13:58.263 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:13:58.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:13:58.547 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-09-21T08:13:59.243 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:13:59.256 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:13:59.257 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:13:59.260 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:13:59.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:00.565 INFO:teuthology.orchestra.run.smithi040.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:14:00.587 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/669 2024-09-21T08:14:00.587 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/669 2024-09-21T08:14:00.587 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:14:00.600 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:00.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:14:00.923 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-09-21T08:14:01.694 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:14:01.708 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:14:01.708 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:14:01.710 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:14:01.710 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:02.941 INFO:teuthology.orchestra.run.smithi040.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:14:02.967 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/670 2024-09-21T08:14:02.967 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/670 2024-09-21T08:14:02.967 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:14:02.977 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:03.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:14:03.546 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-09-21T08:14:04.161 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:14:04.165 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:14:04.167 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:14:04.168 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:05.480 INFO:teuthology.orchestra.run.smithi040.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:14:05.505 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/671 2024-09-21T08:14:05.506 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/671 2024-09-21T08:14:05.506 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:14:05.524 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:06.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:14:06.000 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-09-21T08:14:06.829 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:14:06.841 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:14:06.843 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:14:06.845 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:14:06.846 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:08.072 INFO:teuthology.orchestra.run.smithi040.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:14:08.084 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/672 2024-09-21T08:14:08.084 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/672 2024-09-21T08:14:08.084 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:14:08.087 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:08.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:14:08.380 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-09-21T08:14:09.207 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:14:09.216 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:14:09.216 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:14:09.218 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:14:09.218 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:10.966 INFO:teuthology.orchestra.run.smithi040.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:14:10.989 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/673 2024-09-21T08:14:10.989 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/673 2024-09-21T08:14:10.990 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:14:11.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:11.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:14:11.427 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-09-21T08:14:12.179 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:14:12.194 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:14:12.194 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:14:12.196 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:14:12.196 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:13.281 INFO:teuthology.orchestra.run.smithi040.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-09-21T08:14:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/674 2024-09-21T08:14:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/674 2024-09-21T08:14:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:14:13.395 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:13.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:14:13.964 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-09-21T08:14:14.632 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:14:14.645 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:14:14.646 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:14:14.647 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:14:14.647 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:15.939 INFO:teuthology.orchestra.run.smithi040.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:14:15.952 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/675 2024-09-21T08:14:15.952 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/675 2024-09-21T08:14:15.952 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:14:15.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:16.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:14:16.418 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-09-21T08:14:17.297 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:14:17.313 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:14:17.314 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:14:17.315 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:14:17.315 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:14:25.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:14:25.881 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:14:56.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:14:56.034 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:15:26.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:15:26.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:15:56.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:15:56.280 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:15:56.400 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T08:15:56.399+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 721765) UID: 0 2024-09-21T08:15:56.408 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T08:15:56.399+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 721765) UID: 0 2024-09-21T08:23:57.363 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T08:23:57.361+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 721772) UID: 0 2024-09-21T08:23:57.363 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T08:23:57.361+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 721772) UID: 0 2024-09-21T08:23:57.363 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T08:23:57.361+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 721772) UID: 0 2024-09-21T08:23:57.365 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T08:23:57.364+0000 7f843b458640 -1 Fail to open '/proc/721772/cmdline' error = (2) No such file or directory 2024-09-21T08:23:57.365 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T08:23:57.364+0000 7f843b458640 -1 received signal: Hangup from (PID: 721772) UID: 0 2024-09-21T08:32:01.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:32:01.754 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:32:01.789 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T08:32:01.787+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54552) UID: 0 2024-09-21T08:32:01.789 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T08:32:01.787+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54552) UID: 0 2024-09-21T08:32:01.789 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T08:32:01.787+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54552) UID: 0 2024-09-21T08:32:01.790 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T08:32:01.787+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54552) UID: 0 2024-09-21T08:32:01.876 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T08:32:01.875+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 721814) UID: 0 2024-09-21T08:32:01.877 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T08:32:01.875+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 721814) UID: 0 2024-09-21T08:39:01.360 INFO:teuthology.orchestra.run.smithi040.stdout:generic/676 1484s 2024-09-21T08:39:01.388 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/676 2024-09-21T08:39:01.388 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:01.399 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:01.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:01.610 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-09-21T08:39:02.649 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:02.663 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:02.665 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:02.669 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:02.669 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:03.617 INFO:teuthology.orchestra.run.smithi040.stdout:generic/677 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T08:39:03.624 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/677 2024-09-21T08:39:03.625 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/677 2024-09-21T08:39:03.625 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:03.629 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:03.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:03.678 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-09-21T08:39:04.350 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:04.367 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:04.369 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:04.372 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:04.372 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:05.448 INFO:teuthology.orchestra.run.smithi040.stdout:generic/678 [not run] kernel does not support IO_URING 2024-09-21T08:39:05.467 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/678 2024-09-21T08:39:05.467 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/678 2024-09-21T08:39:05.467 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:05.475 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:05.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:05.549 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-09-21T08:39:06.145 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:06.159 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:06.160 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:06.163 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:06.163 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:07.161 INFO:teuthology.orchestra.run.smithi040.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T08:39:07.176 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/679 2024-09-21T08:39:07.177 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/679 2024-09-21T08:39:07.177 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:07.185 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:07.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:07.238 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-09-21T08:39:07.849 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:07.865 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:07.867 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:07.869 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:07.869 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:10.637 INFO:teuthology.orchestra.run.smithi040.stdout:generic/680 2s 2024-09-21T08:39:10.666 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/680 2024-09-21T08:39:10.667 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:10.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:10.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:10.799 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-09-21T08:39:11.841 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:11.853 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:11.855 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:11.859 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:11.859 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:12.625 INFO:teuthology.orchestra.run.smithi040.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T08:39:12.641 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/681 2024-09-21T08:39:12.642 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/681 2024-09-21T08:39:12.642 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:12.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:12.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:12.722 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-09-21T08:39:13.445 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:13.458 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:13.459 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:13.461 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:13.461 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:14.534 INFO:teuthology.orchestra.run.smithi040.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T08:39:14.548 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/682 2024-09-21T08:39:14.548 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/682 2024-09-21T08:39:14.548 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:14.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:14.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:14.600 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-09-21T08:39:15.109 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:15.118 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:15.120 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:15.123 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:15.123 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:16.114 INFO:teuthology.orchestra.run.smithi040.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T08:39:16.134 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/683 2024-09-21T08:39:16.134 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/683 2024-09-21T08:39:16.135 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:16.141 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:16.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:16.184 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-09-21T08:39:16.943 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:16.956 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:16.958 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:16.961 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:16.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:22.407 INFO:teuthology.orchestra.run.smithi040.stdout:generic/684 - output mismatch (see /tmp/tmp.9vjfAyR2gpxfstests-dev/results//generic/684.out.bad) 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/684.out 2024-09-21 01:50:30.723530168 +0000 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.9vjfAyR2gpxfstests-dev/results//generic/684.out.bad 2024-09-21 08:39:22.389452771 +0000 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,7 +1,7 @@ 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 684 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: Test 1 - qa_user, non-exec file fpunch 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: -666 -rw-rw-rw- TEST_DIR/684/a 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: +2666 -rw-rwSrw- TEST_DIR/684/a 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:22.412 INFO:teuthology.orchestra.run.smithi040.stdout: Test 2 - qa_user, group-exec file fpunch 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: 6676 -rwSrwsrw- TEST_DIR/684/a 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -9,7 +9,7 @@ 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: Test 3 - qa_user, user-exec file fpunch 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: 6766 -rwsrwSrw- TEST_DIR/684/a 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: -766 -rwxrw-rw- TEST_DIR/684/a 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: +2766 -rwxrwSrw- TEST_DIR/684/a 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: Test 4 - qa_user, all-exec file fpunch 2024-09-21T08:39:22.413 INFO:teuthology.orchestra.run.smithi040.stdout: 6777 -rwsrwsrwx TEST_DIR/684/a 2024-09-21T08:39:22.424 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/684 2024-09-21T08:39:22.425 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/684 2024-09-21T08:39:22.425 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2024-09-21T08:39:22.436 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:22.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T08:39:22.613 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-09-21T08:39:22.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-09-21T08:39:22.614 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-09-21T08:39:23.729 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:23.746 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:23.747 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:23.748 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:23.748 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:24.968 INFO:teuthology.orchestra.run.smithi040.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-09-21T08:39:24.981 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/685 2024-09-21T08:39:24.981 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/685 2024-09-21T08:39:24.981 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:24.988 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:25.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:25.066 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-09-21T08:39:25.835 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:25.848 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:25.849 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:25.851 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:25.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:27.174 INFO:teuthology.orchestra.run.smithi040.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-09-21T08:39:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/686 2024-09-21T08:39:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/686 2024-09-21T08:39:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:27.197 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:27.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:27.246 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-09-21T08:39:27.992 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:28.009 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:28.014 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:28.016 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:28.017 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:29.414 INFO:teuthology.orchestra.run.smithi040.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-09-21T08:39:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/687 2024-09-21T08:39:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/687 2024-09-21T08:39:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:29.446 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:29.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:29.572 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-09-21T08:39:30.108 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:30.135 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:30.139 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:30.139 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:31.171 INFO:teuthology.orchestra.run.smithi040.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T08:39:31.187 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/688 2024-09-21T08:39:31.188 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/688 2024-09-21T08:39:31.188 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:31.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:31.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:31.272 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-09-21T08:39:31.963 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:31.979 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:31.981 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:31.984 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:32.849 INFO:teuthology.orchestra.run.smithi040.stdout:generic/689 [not run] vfstest not support by ceph 2024-09-21T08:39:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/689 2024-09-21T08:39:32.868 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/689 2024-09-21T08:39:32.869 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:32.879 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:32.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:32.941 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-09-21T08:39:33.736 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:33.748 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:33.755 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:33.759 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:33.759 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:34.942 INFO:teuthology.orchestra.run.smithi040.stdout:generic/690 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T08:39:34.950 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/690 2024-09-21T08:39:34.950 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/690 2024-09-21T08:39:34.950 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:34.966 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:35.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:35.026 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-09-21T08:39:35.786 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:35.796 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:35.796 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:35.798 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:35.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:36.742 INFO:teuthology.orchestra.run.smithi040.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2024-09-21T08:39:36.758 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/691 2024-09-21T08:39:36.759 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/691 2024-09-21T08:39:36.759 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:36.767 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:36.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:36.807 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-09-21T08:39:37.449 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:37.464 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:37.464 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:37.466 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:37.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:38.193 INFO:teuthology.orchestra.run.smithi040.stdout:generic/692 [not run] fsverity utility required, skipped this test 2024-09-21T08:39:38.213 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/692 2024-09-21T08:39:38.214 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/692 2024-09-21T08:39:38.214 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:38.221 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:38.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:38.278 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-09-21T08:39:38.979 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:39.003 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:39.005 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:39.007 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:39.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:40.385 INFO:teuthology.orchestra.run.smithi040.stdout:generic/693 [not run] kernel does not support ceph encryption 2024-09-21T08:39:40.421 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/693 2024-09-21T08:39:40.422 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/693 2024-09-21T08:39:40.422 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:40.433 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:40.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:40.496 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-09-21T08:39:41.277 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:41.282 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:41.283 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:41.288 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:41.288 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:55.295 INFO:teuthology.orchestra.run.smithi040.stdout:generic/694 14s 2024-09-21T08:39:55.317 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/694 2024-09-21T08:39:55.318 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:55.329 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:55.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:55.359 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-09-21T08:39:56.028 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:56.045 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:56.047 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:56.051 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:56.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:56.897 INFO:teuthology.orchestra.run.smithi040.stdout:generic/695 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T08:39:56.919 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/695 2024-09-21T08:39:56.920 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/695 2024-09-21T08:39:56.920 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:56.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:56.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:39:56.987 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-09-21T08:39:57.635 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:39:57.646 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:39:57.648 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:39:57.651 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:39:57.659 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:39:59.386 INFO:teuthology.orchestra.run.smithi040.stdout:generic/696 2s 2024-09-21T08:39:59.420 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/696 2024-09-21T08:39:59.420 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:39:59.429 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:00.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:00.101 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-09-21T08:40:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:01.274 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:01.276 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:01.280 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:01.280 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:02.822 INFO:teuthology.orchestra.run.smithi040.stdout:generic/697 1s 2024-09-21T08:40:02.854 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/697 2024-09-21T08:40:02.854 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:02.863 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:03.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:03.033 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-09-21T08:40:04.067 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:04.099 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:04.101 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:04.103 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:04.103 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:05.085 INFO:teuthology.orchestra.run.smithi040.stdout:generic/698 [not run] vfstest not support by ceph 2024-09-21T08:40:05.100 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/698 2024-09-21T08:40:05.100 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/698 2024-09-21T08:40:05.100 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:05.110 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:05.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:05.168 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-09-21T08:40:05.895 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:05.915 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:05.915 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:05.919 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:05.919 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:06.789 INFO:teuthology.orchestra.run.smithi040.stdout:generic/699 [not run] vfstest not support by ceph 2024-09-21T08:40:06.806 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/699 2024-09-21T08:40:06.806 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/699 2024-09-21T08:40:06.806 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:06.815 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:06.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:06.894 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-09-21T08:40:07.692 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:07.708 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:07.710 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:07.714 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:07.714 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:08.756 INFO:teuthology.orchestra.run.smithi040.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2024-09-21T08:40:08.775 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/700 2024-09-21T08:40:08.775 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/700 2024-09-21T08:40:08.776 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:08.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:08.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:08.902 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-09-21T08:40:10.006 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:10.023 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:10.024 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:10.027 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:10.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:24.576 INFO:teuthology.orchestra.run.smithi040.stdout:generic/701 14s 2024-09-21T08:40:24.600 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/701 2024-09-21T08:40:24.601 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:24.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:28.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:28.373 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-09-21T08:40:29.483 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:29.499 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:29.506 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:29.512 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:29.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T08:40:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/702 2024-09-21T08:40:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/702 2024-09-21T08:40:30.990 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:31.005 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:31.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:31.775 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-09-21T08:40:32.502 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:32.520 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:32.522 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:32.526 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:32.526 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:33.375 INFO:teuthology.orchestra.run.smithi040.stdout:generic/703 [not run] kernel does not support IO_URING 2024-09-21T08:40:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/703 2024-09-21T08:40:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/703 2024-09-21T08:40:33.390 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:33.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:33.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:33.460 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-09-21T08:40:34.205 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:34.220 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:34.220 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:34.224 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:34.224 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:35.211 INFO:teuthology.orchestra.run.smithi040.stdout:generic/704 [not run] require 172.21.15.40:6789:/test to be valid block disk 2024-09-21T08:40:35.218 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/704 2024-09-21T08:40:35.218 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/704 2024-09-21T08:40:35.219 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:35.229 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:35.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:35.288 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-09-21T08:40:36.010 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:36.019 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:36.021 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:36.024 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:36.025 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:37.167 INFO:teuthology.orchestra.run.smithi040.stdout:generic/705 [not run] ceph does not support shutdown 2024-09-21T08:40:37.217 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/705 2024-09-21T08:40:37.217 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/705 2024-09-21T08:40:37.217 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:37.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:37.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:37.282 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-09-21T08:40:38.025 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:38.039 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:38.041 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:38.044 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:38.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:42.077 INFO:teuthology.orchestra.run.smithi040.stdout:generic/706 4s 2024-09-21T08:40:42.101 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/706 2024-09-21T08:40:42.101 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T08:40:42.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:40:42.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T08:40:42.273 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-09-21T08:40:43.192 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T08:40:43.204 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T08:40:43.206 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T08:40:43.214 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T08:40:43.214 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T08:49:32.062 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T08:49:32.059+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757428) UID: 0 2024-09-21T08:49:32.063 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T08:49:32.059+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757428) UID: 0 2024-09-21T08:49:32.065 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T08:49:32.060+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757428) UID: 0 2024-09-21T08:49:32.066 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T08:49:32.060+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757428) UID: 0 2024-09-21T08:57:18.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:57:18.901 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T08:57:18.930 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T08:57:18.928+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54590) UID: 0 2024-09-21T08:57:18.930 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T08:57:18.928+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54590) UID: 0 2024-09-21T08:57:18.931 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T08:57:18.928+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54590) UID: 0 2024-09-21T08:57:18.931 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T08:57:18.928+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54590) UID: 0 2024-09-21T08:57:19.021 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T08:57:19.019+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 774589) UID: 0 2024-09-21T08:57:19.021 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T08:57:19.019+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 774589) UID: 0 2024-09-21T09:10:49.511 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-21T09:10:49.508+0000 7fdab7f1b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 803483) UID: 0 2024-09-21T09:10:49.516 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-21T09:10:49.509+0000 7f843b458640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 803483) UID: 0 2024-09-21T09:10:49.517 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-21T09:10:49.508+0000 7f7fecdd7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 803483) UID: 0 2024-09-21T09:10:49.517 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-09-21T09:10:49.508+0000 7f4c55ad8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 803483) UID: 0 2024-09-21T09:25:48.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:25:48.346 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:25:48.384 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-21T09:25:48.382+0000 7f668efa1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54648) UID: 0 2024-09-21T09:25:48.385 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-21T09:25:48.382+0000 7fb8d227c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54648) UID: 0 2024-09-21T09:25:48.385 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-21T09:25:48.382+0000 7f2a1ab13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54648) UID: 0 2024-09-21T09:25:48.385 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-21T09:25:48.382+0000 7fc737969640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54648) UID: 0 2024-09-21T09:25:48.447 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-21T09:25:48.445+0000 7f5dff06b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 832974) UID: 0 2024-09-21T09:25:48.447 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-21T09:25:48.445+0000 7f8060e2d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 832974) UID: 0 2024-09-21T09:27:40.910 INFO:teuthology.orchestra.run.smithi040.stdout:generic/707 2817s 2024-09-21T09:27:40.965 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/707 2024-09-21T09:27:40.965 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:27:40.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:41.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:27:41.019 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-09-21T09:27:41.899 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:27:41.909 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:27:41.911 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:27:41.915 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:27:41.915 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:49.790 INFO:teuthology.orchestra.run.smithi040.stdout:generic/708 1s 2024-09-21T09:27:49.817 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/708 2024-09-21T09:27:49.818 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:27:49.824 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:50.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:27:50.060 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-09-21T09:27:50.954 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:27:50.969 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:27:50.970 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:27:50.974 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:27:50.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:51.720 INFO:teuthology.orchestra.run.smithi040.stdout:generic/709 [not run] xfs_io exchangerange support is missing 2024-09-21T09:27:51.728 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/709 2024-09-21T09:27:51.729 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/709 2024-09-21T09:27:51.729 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:27:51.736 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:51.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:27:51.897 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-09-21T09:27:52.713 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:27:52.731 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:27:52.733 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:27:52.745 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:27:52.745 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:53.592 INFO:teuthology.orchestra.run.smithi040.stdout:generic/710 [not run] xfs_io exchangerange support is missing 2024-09-21T09:27:53.620 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/710 2024-09-21T09:27:53.621 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/710 2024-09-21T09:27:53.621 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:27:53.633 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:53.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:27:53.787 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-09-21T09:27:54.642 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:27:54.650 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:27:54.656 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:27:54.661 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:27:54.661 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:55.491 INFO:teuthology.orchestra.run.smithi040.stdout:generic/711 [not run] xfs_io swapext not supported on ceph 2024-09-21T09:27:55.497 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/711 2024-09-21T09:27:55.497 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/711 2024-09-21T09:27:55.501 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:27:55.508 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:55.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:27:55.692 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-09-21T09:27:56.499 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:27:56.517 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:27:56.519 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:27:56.522 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:27:56.522 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:57.420 INFO:teuthology.orchestra.run.smithi040.stdout:generic/712 [not run] xfs_io exchangerange support is missing 2024-09-21T09:27:57.435 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/712 2024-09-21T09:27:57.435 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/712 2024-09-21T09:27:57.435 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:27:57.445 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:57.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:27:57.604 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-09-21T09:27:58.572 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:27:58.581 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:27:58.582 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:27:58.586 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:27:58.586 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:59.469 INFO:teuthology.orchestra.run.smithi040.stdout:generic/713 [not run] xfs_io exchangerange -s 64k -l 64k support is missing 2024-09-21T09:27:59.487 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/713 2024-09-21T09:27:59.488 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/713 2024-09-21T09:27:59.488 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:27:59.498 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:27:59.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:27:59.590 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-09-21T09:28:00.436 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:00.450 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:00.452 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:00.457 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:00.457 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:01.338 INFO:teuthology.orchestra.run.smithi040.stdout:generic/714 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:01.354 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/714 2024-09-21T09:28:01.355 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/714 2024-09-21T09:28:01.355 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:01.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:01.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:01.503 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-09-21T09:28:02.479 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:02.496 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:02.500 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:02.502 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:02.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:03.366 INFO:teuthology.orchestra.run.smithi040.stdout:generic/715 [not run] xfs_io exchangerange -s 64k -l 64k support is missing 2024-09-21T09:28:03.378 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/715 2024-09-21T09:28:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/715 2024-09-21T09:28:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:03.383 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:03.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:03.528 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-09-21T09:28:04.396 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:04.414 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:04.416 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:04.420 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:04.420 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:05.153 INFO:teuthology.orchestra.run.smithi040.stdout:generic/716 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:05.167 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/716 2024-09-21T09:28:05.167 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/716 2024-09-21T09:28:05.167 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:05.170 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:05.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:05.324 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-09-21T09:28:06.235 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:06.240 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:06.240 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:06.243 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:06.243 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:07.056 INFO:teuthology.orchestra.run.smithi040.stdout:generic/717 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:07.076 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/717 2024-09-21T09:28:07.076 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/717 2024-09-21T09:28:07.076 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:07.079 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:07.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:07.185 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-09-21T09:28:08.202 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:08.218 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:08.220 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:08.224 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:08.224 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:08.964 INFO:teuthology.orchestra.run.smithi040.stdout:generic/718 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:08.981 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/718 2024-09-21T09:28:08.981 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/718 2024-09-21T09:28:08.982 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:08.992 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:09.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:09.112 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-09-21T09:28:10.051 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:10.058 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:10.060 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:10.063 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:10.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:10.836 INFO:teuthology.orchestra.run.smithi040.stdout:generic/719 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:10.849 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/719 2024-09-21T09:28:10.849 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/719 2024-09-21T09:28:10.849 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:10.854 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:10.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:10.976 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-09-21T09:28:11.857 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:11.866 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:11.867 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:11.868 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:11.869 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:12.769 INFO:teuthology.orchestra.run.smithi040.stdout:generic/720 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:12.778 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/720 2024-09-21T09:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/720 2024-09-21T09:28:12.779 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:12.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:12.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:12.917 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-09-21T09:28:13.729 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:13.746 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:13.750 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:13.753 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:14.450 INFO:teuthology.orchestra.run.smithi040.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-09-21T09:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/721 2024-09-21T09:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/721 2024-09-21T09:28:14.457 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:14.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:14.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:14.521 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-09-21T09:28:15.186 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:15.207 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:15.208 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:15.211 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:15.211 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:16.041 INFO:teuthology.orchestra.run.smithi040.stdout:generic/722 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:16.048 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/722 2024-09-21T09:28:16.048 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/722 2024-09-21T09:28:16.048 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:16.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:16.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:16.140 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-09-21T09:28:17.072 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:17.077 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:17.077 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:17.078 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:17.078 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:17.731 INFO:teuthology.orchestra.run.smithi040.stdout:generic/723 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:17.746 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/723 2024-09-21T09:28:17.747 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/723 2024-09-21T09:28:17.747 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:17.754 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:17.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:17.893 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-09-21T09:28:18.732 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:18.748 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:18.750 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:18.753 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:18.753 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:19.716 INFO:teuthology.orchestra.run.smithi040.stdout:generic/724 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:19.733 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/724 2024-09-21T09:28:19.733 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/724 2024-09-21T09:28:19.733 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:19.739 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:19.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:19.823 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-09-21T09:28:20.806 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:20.826 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:20.828 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:20.832 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:20.832 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:21.665 INFO:teuthology.orchestra.run.smithi040.stdout:generic/725 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/725 2024-09-21T09:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/725 2024-09-21T09:28:21.672 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:21.683 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:21.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:21.799 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-09-21T09:28:22.657 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:22.677 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:22.678 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:22.680 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:22.680 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:24.396 INFO:teuthology.orchestra.run.smithi040.stdout:generic/726 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:24.409 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/726 2024-09-21T09:28:24.410 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/726 2024-09-21T09:28:24.410 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:24.419 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:24.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:24.549 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-09-21T09:28:25.451 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:25.461 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:25.462 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:25.463 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:25.464 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:26.395 INFO:teuthology.orchestra.run.smithi040.stdout:generic/727 [not run] xfs_io exchangerange support is missing 2024-09-21T09:28:26.401 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/727 2024-09-21T09:28:26.401 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/727 2024-09-21T09:28:26.401 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:26.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:26.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:26.554 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-09-21T09:28:27.482 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:27.494 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:27.498 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:27.499 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:generic/728 5s 2024-09-21T09:28:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/728 2024-09-21T09:28:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:32.665 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:32.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:32.762 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-09-21T09:28:33.702 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:33.722 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:33.725 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:33.725 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:35.201 INFO:teuthology.orchestra.run.smithi040.stdout:generic/729 2s 2024-09-21T09:28:35.216 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/729 2024-09-21T09:28:35.217 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:35.224 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:35.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:35.295 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-09-21T09:28:36.129 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:36.146 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:36.148 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:36.151 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:36.151 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:36.883 INFO:teuthology.orchestra.run.smithi040.stdout:generic/730 [not run] require 172.21.15.40:6789:/test to be valid block disk 2024-09-21T09:28:36.892 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/730 2024-09-21T09:28:36.893 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/730 2024-09-21T09:28:36.893 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:36.903 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:36.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:36.927 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-09-21T09:28:37.546 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:37.556 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:37.556 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:37.557 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:37.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:38.213 INFO:teuthology.orchestra.run.smithi040.stdout:generic/731 [not run] require 172.21.15.40:6789:/test to be valid block disk 2024-09-21T09:28:38.219 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/731 2024-09-21T09:28:38.220 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/731 2024-09-21T09:28:38.220 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:38.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:38.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:38.251 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-09-21T09:28:38.982 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:38.999 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:39.001 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:39.004 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:39.005 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:41.237 INFO:teuthology.orchestra.run.smithi040.stdout:generic/732 2s 2024-09-21T09:28:41.269 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/732 2024-09-21T09:28:41.269 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:41.280 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:41.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:41.340 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-09-21T09:28:42.174 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:42.190 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:42.192 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:42.198 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:42.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:43.753 INFO:teuthology.orchestra.run.smithi040.stdout:generic/733 [not run] Reflink not supported by scratch filesystem type: ceph 2024-09-21T09:28:43.773 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/733 2024-09-21T09:28:43.773 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/733 2024-09-21T09:28:43.777 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:43.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:43.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:43.967 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-09-21T09:28:44.835 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:44.852 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:44.854 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:44.860 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:44.860 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:45.871 INFO:teuthology.orchestra.run.smithi040.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph 2024-09-21T09:28:45.886 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/734 2024-09-21T09:28:45.886 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/734 2024-09-21T09:28:45.886 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:45.890 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:46.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:46.007 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-09-21T09:28:46.938 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:46.953 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:46.957 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:46.961 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:46.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:48.048 INFO:teuthology.orchestra.run.smithi040.stdout:generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T09:28:48.066 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/735 2024-09-21T09:28:48.067 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/735 2024-09-21T09:28:48.067 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:28:48.078 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:28:48.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:28:48.207 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-09-21T09:28:49.173 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:28:49.186 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:28:49.188 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:28:49.190 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:28:49.190 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:03.085 INFO:teuthology.orchestra.run.smithi040.stdout:generic/736 314s 2024-09-21T09:34:03.111 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/736 2024-09-21T09:34:03.112 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:03.124 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:03.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:03.427 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-09-21T09:34:04.559 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:04.567 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:04.568 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:04.571 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:04.571 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:05.995 INFO:teuthology.orchestra.run.smithi040.stdout:generic/737 [not run] ceph does not support shutdown 2024-09-21T09:34:06.022 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/737 2024-09-21T09:34:06.022 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/737 2024-09-21T09:34:06.022 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:06.031 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:06.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:06.074 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-09-21T09:34:06.690 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:06.703 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:06.704 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:06.709 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:06.709 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:07.672 INFO:teuthology.orchestra.run.smithi040.stdout:generic/738 [not run] ceph does not support freezing 2024-09-21T09:34:07.682 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/738 2024-09-21T09:34:07.683 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/738 2024-09-21T09:34:07.683 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:07.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:07.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:07.723 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-09-21T09:34:08.474 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:08.489 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:08.490 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:08.494 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:08.494 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:09.577 INFO:teuthology.orchestra.run.smithi040.stdout:generic/739 [not run] xfs_io set_encpolicy doesn't support -s 2024-09-21T09:34:09.599 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/739 2024-09-21T09:34:09.600 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/739 2024-09-21T09:34:09.600 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:09.611 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:09.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:09.686 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/740) 2024-09-21T09:34:10.565 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:10.578 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:10.578 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:10.579 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:10.579 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:11.437 INFO:teuthology.orchestra.run.smithi040.stdout:generic/740 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T09:34:11.449 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/740 2024-09-21T09:34:11.449 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/740 2024-09-21T09:34:11.449 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:11.452 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:11.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:11.497 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/741) 2024-09-21T09:34:12.202 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:12.220 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:12.221 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:12.222 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:12.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:13.199 INFO:teuthology.orchestra.run.smithi040.stdout:generic/741 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T09:34:13.209 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/741 2024-09-21T09:34:13.209 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/741 2024-09-21T09:34:13.209 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:13.213 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:13.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:13.254 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/742) 2024-09-21T09:34:13.956 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:13.966 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:13.966 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:13.967 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:13.967 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:15.370 INFO:teuthology.orchestra.run.smithi040.stdout:generic/742 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T09:34:15.388 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/742 2024-09-21T09:34:15.389 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/742 2024-09-21T09:34:15.389 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:15.400 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:15.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:15.487 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/743) 2024-09-21T09:34:16.425 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:16.434 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:16.436 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:16.438 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:16.439 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:17.255 INFO:teuthology.orchestra.run.smithi040.stdout:generic/743 [not run] xfs_io madvise doesn't support -R 2024-09-21T09:34:17.272 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/743 2024-09-21T09:34:17.272 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/743 2024-09-21T09:34:17.272 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:17.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:17.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:17.321 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/744) 2024-09-21T09:34:18.168 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:18.175 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:18.176 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:18.179 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:18.179 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:19.155 INFO:teuthology.orchestra.run.smithi040.stdout:generic/744 [not run] ceph does not support duplicate fsid 2024-09-21T09:34:19.168 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/744 2024-09-21T09:34:19.168 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/744 2024-09-21T09:34:19.168 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:19.174 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:19.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:19.214 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/745) 2024-09-21T09:34:20.027 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:20.041 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:20.042 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:20.050 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:20.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:20.948 INFO:teuthology.orchestra.run.smithi040.stdout:generic/745 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2024-09-21T09:34:20.964 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/745 2024-09-21T09:34:20.964 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/745 2024-09-21T09:34:20.965 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:20.971 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:21.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:21.021 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/746) 2024-09-21T09:34:21.795 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:21.822 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:21.827 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:21.830 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:21.830 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:22.640 INFO:teuthology.orchestra.run.smithi040.stdout:generic/746 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-09-21T09:34:22.652 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/746 2024-09-21T09:34:22.652 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/746 2024-09-21T09:34:22.652 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:22.660 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:22.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:22.725 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/747) 2024-09-21T09:34:23.342 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:23.347 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:23.348 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:23.350 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:23.350 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:24.144 INFO:teuthology.orchestra.run.smithi040.stdout:generic/747 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-09-21T09:34:24.160 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/747 2024-09-21T09:34:24.161 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/747 2024-09-21T09:34:24.161 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:24.170 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:24.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:24.225 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/748) 2024-09-21T09:34:24.896 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:24.906 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:24.907 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:24.908 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:24.909 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:26.486 INFO:teuthology.orchestra.run.smithi040.stdout:generic/748 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-09-21T09:34:26.507 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/748 2024-09-21T09:34:26.507 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/748 2024-09-21T09:34:26.507 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:26.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:26.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:26.699 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/749) 2024-09-21T09:34:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:27.719 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:27.721 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:27.724 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:27.724 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:29.201 INFO:teuthology.orchestra.run.smithi040.stdout:generic/749 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-09-21T09:34:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/749 2024-09-21T09:34:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/749 2024-09-21T09:34:29.218 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2024-09-21T09:34:29.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:34:29.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-09-21T09:34:29.297 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.9vjfAyR2gpxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/750) 2024-09-21T09:34:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2024-09-21T09:34:30.102 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 2024-09-21T09:34:30.103 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2024-09-21T09:34:30.105 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQD2Je5mCHQBDhAA+iWM9ZTAKFnV+Tn8H4qpBA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.j6CdXJYUQdscratch 2024-09-21T09:34:30.106 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-21T09:35:05.466 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:35:05.472 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:35:35.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:35:35.717 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:36:05.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:36:05.904 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:36:36.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:36:36.201 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:37:06.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:37:06.373 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:37:36.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:37:36.551 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:38:06.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:38:06.658 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:38:36.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:38:36.814 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:39:06.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:39:06.994 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:39:37.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:39:37.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:40:07.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:40:07.264 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T09:40:08.771 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-09-21T09:40:08.771 DEBUG:teuthology.task.console_log:Killing console logger for smithi040 2024-09-21T09:40:08.771 DEBUG:teuthology.task.console_log:Killing console logger for smithi139 2024-09-21T09:40:08.771 DEBUG:teuthology.exit:Finished running handlers